2025-11-08 10:15:07 [scrapy.utils.log] (PID: 109) INFO: Scrapy 2.12.0 started (bot: catalog_extraction) 2025-11-08 10:15:07 [scrapy.utils.log] (PID: 109) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36 2025-11-08 10:15:07 [smith_corona] (PID: 109) INFO: Starting extraction spider smith_corona... 2025-11-08 10:15:07 [scrapy.addons] (PID: 109) INFO: Enabled addons: [] 2025-11-08 10:15:07 [py.warnings] (PID: 109) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting. It will be removed in a future version of Scrapy. return cls(crawler) 2025-11-08 10:15:07 [scrapy.extensions.telnet] (PID: 109) INFO: Telnet Password: 89b0582f0c9ff4e5 2025-11-08 10:15:07 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 10:15:07 [scrapy.middleware] (PID: 109) INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.closespider.CloseSpider', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2025-11-08 10:15:07 [scrapy.crawler] (PID: 109) INFO: Overridden settings: {'BOT_NAME': 'catalog_extraction', 'CONCURRENT_ITEMS': 250, 'CONCURRENT_REQUESTS': 24, 'DOWNLOAD_DELAY': 1.25, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/smith_corona/c939b760bc8b11f08d4f4200a9fe0102.log', 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: ' '%(message)s', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_extraction.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 403], 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['catalog_extraction.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': None} 2025-11-08 10:15:08 [scrapy_poet.injection] (PID: 109) INFO: Loading providers: [, , , , , , ] 2025-11-08 10:15:08 [scrapy.middleware] (PID: 109) INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2025-11-08 10:15:08 [NotFoundHandlerSpiderMiddleware] (PID: 109) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment. 2025-11-08 10:15:08 [scrapy.middleware] (PID: 109) INFO: Enabled spider middlewares: ['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware', 'catalog_extraction.middlewares.FixtureSavingMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-11-08 10:15:08 [scrapy.middleware] (PID: 109) INFO: Enabled item pipelines: ['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline', 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline', 'catalog_extraction.pipelines.PriceRoundingPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2025-11-08 10:15:08 [scrapy.core.engine] (PID: 109) INFO: Spider opened 2025-11-08 10:15:08 [scrapy.extensions.closespider] (PID: 109) INFO: Spider will stop when no items are produced after 1800 seconds. 2025-11-08 10:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-11-08 10:15:08 [scrapy.extensions.telnet] (PID: 109) INFO: Telnet console listening on 127.0.0.1:6026 2025-11-08 10:15:10 [ProxyManagerDownloaderMiddleware] (PID: 109) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware. 2025-11-08 10:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG1510APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0866*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9402 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 37 pages (at 37 pages/min), scraped 12 items (at 12 items/min) 2025-11-08 10:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP-UPS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDF4060AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 75 pages (at 38 pages/min), scraped 26 items (at 14 items/min) 2025-11-08 10:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 114 pages (at 39 pages/min), scraped 50 items (at 24 items/min) 2025-11-08 10:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 154 pages (at 40 pages/min), scraped 75 items (at 25 items/min) 2025-11-08 10:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 192 pages (at 38 pages/min), scraped 92 items (at 17 items/min) 2025-11-08 10:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 231 pages (at 39 pages/min), scraped 106 items (at 14 items/min) 2025-11-08 10:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 270 pages (at 39 pages/min), scraped 126 items (at 20 items/min) 2025-11-08 10:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 310 pages (at 40 pages/min), scraped 151 items (at 25 items/min) 2025-11-08 10:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 349 pages (at 39 pages/min), scraped 172 items (at 21 items/min) 2025-11-08 10:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 387 pages (at 38 pages/min), scraped 185 items (at 13 items/min) 2025-11-08 10:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 427 pages (at 40 pages/min), scraped 203 items (at 18 items/min) 2025-11-08 10:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 467 pages (at 40 pages/min), scraped 227 items (at 24 items/min) 2025-11-08 10:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 508 pages (at 41 pages/min), scraped 252 items (at 25 items/min) 2025-11-08 10:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 547 pages (at 39 pages/min), scraped 269 items (at 17 items/min) 2025-11-08 10:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 588 pages (at 41 pages/min), scraped 286 items (at 17 items/min) 2025-11-08 10:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 627 pages (at 39 pages/min), scraped 304 items (at 18 items/min) 2025-11-08 10:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S636WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT40625AP-DYMO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 666 pages (at 39 pages/min), scraped 328 items (at 24 items/min) 2025-11-08 10:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 707 pages (at 41 pages/min), scraped 351 items (at 23 items/min) 2025-11-08 10:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4070-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 745 pages (at 38 pages/min), scraped 366 items (at 15 items/min) 2025-11-08 10:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4000-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 786 pages (at 41 pages/min), scraped 384 items (at 18 items/min) 2025-11-08 10:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 823 pages (at 37 pages/min), scraped 405 items (at 21 items/min) 2025-11-08 10:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 865 pages (at 42 pages/min), scraped 428 items (at 23 items/min) 2025-11-08 10:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 905 pages (at 40 pages/min), scraped 449 items (at 21 items/min) 2025-11-08 10:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 946 pages (at 41 pages/min), scraped 466 items (at 17 items/min) 2025-11-08 10:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 984 pages (at 38 pages/min), scraped 483 items (at 17 items/min) 2025-11-08 10:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1023 pages (at 39 pages/min), scraped 505 items (at 22 items/min) 2025-11-08 10:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1066 pages (at 43 pages/min), scraped 528 items (at 23 items/min) 2025-11-08 10:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1105 pages (at 39 pages/min), scraped 549 items (at 21 items/min) 2025-11-08 10:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1143 pages (at 38 pages/min), scraped 564 items (at 15 items/min) 2025-11-08 10:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1181 pages (at 38 pages/min), scraped 581 items (at 17 items/min) 2025-11-08 10:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1219 pages (at 38 pages/min), scraped 605 items (at 24 items/min) 2025-11-08 10:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4065APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0512*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1260 pages (at 41 pages/min), scraped 627 items (at 22 items/min) 2025-11-08 10:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4080 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1299 pages (at 39 pages/min), scraped 643 items (at 16 items/min) 2025-11-08 10:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETP4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1339 pages (at 40 pages/min), scraped 662 items (at 19 items/min) 2025-11-08 10:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1375 pages (at 36 pages/min), scraped 682 items (at 20 items/min) 2025-11-08 10:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1418 pages (at 43 pages/min), scraped 705 items (at 23 items/min) 2025-11-08 10:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1456 pages (at 38 pages/min), scraped 724 items (at 19 items/min) 2025-11-08 10:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1495 pages (at 39 pages/min), scraped 739 items (at 15 items/min) 2025-11-08 10:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1538 pages (at 43 pages/min), scraped 761 items (at 22 items/min) 2025-11-08 10:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-crystal-clear-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1570 pages (at 32 pages/min), scraped 780 items (at 19 items/min) 2025-11-08 10:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1613 pages (at 43 pages/min), scraped 801 items (at 21 items/min) 2025-11-08 10:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1651 pages (at 38 pages/min), scraped 820 items (at 19 items/min) 2025-11-08 10:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1691 pages (at 40 pages/min), scraped 838 items (at 18 items/min) 2025-11-08 10:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1729 pages (at 38 pages/min), scraped 858 items (at 20 items/min) 2025-11-08 10:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 10:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1770 pages (at 41 pages/min), scraped 880 items (at 22 items/min) 2025-11-08 11:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1811 pages (at 41 pages/min), scraped 900 items (at 20 items/min) 2025-11-08 11:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-sheet-labels-fluorescent-green-195.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-fluorescent-green-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-42-x-0-58-sheet-labels-fluorescent-green-675.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-3-33-sheet-labels-fluorescent-green-863.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-fluorescent-yellow-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-666-x-1-666-sheet-labels-fluorescent-yellow-212.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-6562-x-2-75-sheet-labels-fluorescent-yellow-475.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-sheet-labels-fluorescent-green-195.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-fluorescent-green-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1832 pages (at 21 pages/min), scraped 909 items (at 9 items/min) 2025-11-08 11:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-sheet-labels-fluorescent-yellow-770.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-42-x-0-58-sheet-labels-fluorescent-green-675.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-fluorescent-yellow-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-666-x-1-666-sheet-labels-fluorescent-yellow-212.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-6562-x-2-75-sheet-labels-fluorescent-yellow-475.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-fluorescent-green-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-sheet-labels-fluorescent-yellow-770.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-375-x-1-4375-sheet-labels-fluorescent-orange-520.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-125-x-0-5-sheet-labels-fluorescent-orange-832.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-fluorescent-yellow-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-6562-x-2-75-sheet-labels-fluorescent-yellow-475.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1846 pages (at 14 pages/min), scraped 915 items (at 6 items/min) 2025-11-08 11:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-2-75-sheet-labels-fluorescent-orange-890.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-656-x-4-656-sheet-labels-fluorescent-blue-35.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-11-sheet-labels-fluorescent-blue-129.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-2-75-sheet-labels-fluorescent-orange-890.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-10-sheet-labels-gold-foil-78.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1862 pages (at 16 pages/min), scraped 921 items (at 6 items/min) 2025-11-08 11:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-2-75-sheet-labels-fluorescent-orange-890.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:43 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:04:43 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FG>: HTTP status code is not handled or not allowed 2025-11-08 11:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-gold-foil-135.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:04:57 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:04:57 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FG>: HTTP status code is not handled or not allowed 2025-11-08 11:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-1-sheet-labels-gold-foil-182.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1881 pages (at 19 pages/min), scraped 933 items (at 12 items/min) 2025-11-08 11:05:09 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:05:09 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FG>: HTTP status code is not handled or not allowed 2025-11-08 11:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-8584-x-4-8037-sheet-labels-gold-foil-827.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/7-x-4-875-sheet-labels-gold-foil-861.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-sheet-labels-silver-foil-44.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1910 pages (at 29 pages/min), scraped 946 items (at 13 items/min) 2025-11-08 11:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-BR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9310 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9330 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1950 pages (at 40 pages/min), scraped 965 items (at 19 items/min) 2025-11-08 11:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S906GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S385WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S916CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-TOP-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-ORANGE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 1989 pages (at 39 pages/min), scraped 985 items (at 20 items/min) 2025-11-08 11:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:49 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 11:08:51 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1 2025-11-08 11:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3100A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2031 pages (at 42 pages/min), scraped 1005 items (at 20 items/min) 2025-11-08 11:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT5030-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2071 pages (at 40 pages/min), scraped 1027 items (at 22 items/min) 2025-11-08 11:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2109 pages (at 38 pages/min), scraped 1045 items (at 18 items/min) 2025-11-08 11:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2151 pages (at 42 pages/min), scraped 1065 items (at 20 items/min) 2025-11-08 11:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2191 pages (at 40 pages/min), scraped 1087 items (at 22 items/min) 2025-11-08 11:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2231 pages (at 40 pages/min), scraped 1107 items (at 20 items/min) 2025-11-08 11:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2270 pages (at 39 pages/min), scraped 1127 items (at 20 items/min) 2025-11-08 11:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2311 pages (at 41 pages/min), scraped 1145 items (at 18 items/min) 2025-11-08 11:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2348 pages (at 37 pages/min), scraped 1164 items (at 19 items/min) 2025-11-08 11:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2387 pages (at 39 pages/min), scraped 1185 items (at 21 items/min) 2025-11-08 11:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2425 pages (at 38 pages/min), scraped 1205 items (at 20 items/min) 2025-11-08 11:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2466 pages (at 41 pages/min), scraped 1225 items (at 20 items/min) 2025-11-08 11:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2506 pages (at 40 pages/min), scraped 1243 items (at 18 items/min) 2025-11-08 11:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2545 pages (at 39 pages/min), scraped 1263 items (at 20 items/min) 2025-11-08 11:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3030APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1182*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2584 pages (at 39 pages/min), scraped 1284 items (at 21 items/min) 2025-11-08 11:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4020-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFD4060-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4013-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2623 pages (at 39 pages/min), scraped 1303 items (at 19 items/min) 2025-11-08 11:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2662 pages (at 39 pages/min), scraped 1321 items (at 18 items/min) 2025-11-08 11:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2703 pages (at 41 pages/min), scraped 1341 items (at 20 items/min) 2025-11-08 11:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2742 pages (at 39 pages/min), scraped 1362 items (at 21 items/min) 2025-11-08 11:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2780 pages (at 38 pages/min), scraped 1383 items (at 21 items/min) 2025-11-08 11:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2817 pages (at 37 pages/min), scraped 1399 items (at 16 items/min) 2025-11-08 11:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2857 pages (at 40 pages/min), scraped 1418 items (at 19 items/min) 2025-11-08 11:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5625-x-1-8125-sheet-labels-turquoise-625.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-875-x-1-875-sheet-labels-white-polyester-690.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2883 pages (at 26 pages/min), scraped 1431 items (at 13 items/min) 2025-11-08 11:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-9375-x-0-625-sheet-labels-white-vinyl-drum-42.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-white-vinyl-drum-165.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-white-vinyl-drum-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-7225-x-0-5-sheet-labels-white-vinyl-drum-350.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-9375-x-0-625-sheet-labels-white-vinyl-drum-42.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-875-x-0-5-sheet-labels-white-vinyl-drum-866.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-pink-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2903 pages (at 20 pages/min), scraped 1445 items (at 14 items/min) 2025-11-08 11:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-11-sheet-labels-pastel-pink-129.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-5-sheet-labels-pastel-pink-255.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-white-vinyl-drum-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-3-33-sheet-labels-pastel-pink-863.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-1-125-sheet-labels-pastel-pink-865.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-pink-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-pastel-purple-115.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-1-sheet-labels-pastel-purple-190.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-pastel-purple-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-11-sheet-labels-pastel-pink-129.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-33-sheet-labels-pastel-purple-824.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-white-vinyl-drum-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-64-x-4-64-sheet-labels-pastel-purple-115.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-pink-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2917 pages (at 14 pages/min), scraped 1449 items (at 4 items/min) 2025-11-08 11:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-3-33-sheet-labels-pastel-purple-863.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-33-sheet-labels-pastel-purple-824.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-0-5-sheet-labels-white-vinyl-drum-208.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-pastel-pink-885.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:45 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:33:45 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/6-x-4-sheet-labels-white-polyester-110.html>: HTTP status code is not handled or not allowed 2025-11-08 11:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:51 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:51 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203TU>: HTTP status code is not handled or not allowed 2025-11-08 11:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:33:58 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 11:33:58 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/4-25-x-1-5-sheet-labels-white-polyester-400.html>: HTTP status code is not handled or not allowed 2025-11-08 11:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2935 pages (at 18 pages/min), scraped 1457 items (at 8 items/min) 2025-11-08 11:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-blue-20.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-blue-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-117.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-5-x-1-75-sheet-labels-pastel-blue-183.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-sheet-labels-pastel-blue-198.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-0-5-sheet-labels-pastel-blue-295.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-375-x-1-25-sheet-labels-pastel-blue-775.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2955 pages (at 20 pages/min), scraped 1467 items (at 10 items/min) 2025-11-08 11:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-0-5-sheet-labels-pastel-blue-295.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-375-x-1-25-sheet-labels-pastel-blue-775.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 2990 pages (at 35 pages/min), scraped 1483 items (at 16 items/min) 2025-11-08 11:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3032 pages (at 42 pages/min), scraped 1506 items (at 23 items/min) 2025-11-08 11:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3071 pages (at 39 pages/min), scraped 1525 items (at 19 items/min) 2025-11-08 11:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3111 pages (at 40 pages/min), scraped 1544 items (at 19 items/min) 2025-11-08 11:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3149 pages (at 38 pages/min), scraped 1562 items (at 18 items/min) 2025-11-08 11:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3189 pages (at 40 pages/min), scraped 1583 items (at 21 items/min) 2025-11-08 11:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=I*0410*500*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTAG4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*200*1000*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3228 pages (at 39 pages/min), scraped 1604 items (at 21 items/min) 2025-11-08 11:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S918DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S917DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S914EE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3267 pages (at 39 pages/min), scraped 1623 items (at 19 items/min) 2025-11-08 11:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3307 pages (at 40 pages/min), scraped 1642 items (at 19 items/min) 2025-11-08 11:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3346 pages (at 39 pages/min), scraped 1661 items (at 19 items/min) 2025-11-08 11:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3383 pages (at 37 pages/min), scraped 1681 items (at 20 items/min) 2025-11-08 11:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3424 pages (at 41 pages/min), scraped 1702 items (at 21 items/min) 2025-11-08 11:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3464 pages (at 40 pages/min), scraped 1721 items (at 19 items/min) 2025-11-08 11:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3505 pages (at 41 pages/min), scraped 1741 items (at 20 items/min) 2025-11-08 11:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3543 pages (at 38 pages/min), scraped 1760 items (at 19 items/min) 2025-11-08 11:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3584 pages (at 41 pages/min), scraped 1781 items (at 21 items/min) 2025-11-08 11:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3622 pages (at 38 pages/min), scraped 1800 items (at 19 items/min) 2025-11-08 11:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3663 pages (at 41 pages/min), scraped 1820 items (at 20 items/min) 2025-11-08 11:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3704 pages (at 41 pages/min), scraped 1840 items (at 20 items/min) 2025-11-08 11:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3742 pages (at 38 pages/min), scraped 1860 items (at 20 items/min) 2025-11-08 11:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-10-875-sheet-labels-fluorescent-green-340.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-fluorescent-yellow-15.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-4375-x-0-667-sheet-labels-fluorescent-yellow-125.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3770 pages (at 28 pages/min), scraped 1873 items (at 13 items/min) 2025-11-08 11:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3809 pages (at 39 pages/min), scraped 1892 items (at 19 items/min) 2025-11-08 11:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3849 pages (at 40 pages/min), scraped 1913 items (at 21 items/min) 2025-11-08 11:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3888 pages (at 39 pages/min), scraped 1934 items (at 21 items/min) 2025-11-08 11:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-875-x-0-5-sheet-labels-866.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-blue-xs.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-1-core-brown-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 11:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3920 pages (at 32 pages/min), scraped 1950 items (at 16 items/min) 2025-11-08 12:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-nonperforated-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-fanfold-labels-blue.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BLUE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-5-thermal-transfer-fanfold-labels-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-gray-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-fanfold-labels-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-direct-thermal-labels-3-core-nonperforated-film-liner.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-fanfold-labels-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BLUE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3939 pages (at 19 pages/min), scraped 1960 items (at 10 items/min) 2025-11-08 12:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-0-75-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-thermal-transfer-labels-3-core-nonperforated-gray-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-fanfold-labels-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-1-core-blockout-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-hot-pink-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-fanfold-labels-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-grape-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-nonperforated-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-fanfold-labels-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3952 pages (at 13 pages/min), scraped 1967 items (at 7 items/min) 2025-11-08 12:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-1-core-blockout-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-fanfold-labels-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-grape-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:39 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 12:02:39 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-6-direct-thermal-labels-0-75-core-green.html>: HTTP status code is not handled or not allowed 2025-11-08 12:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-1-core-blockout-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-sheet-labels-blockout-99.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-grape-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3966 pages (at 14 pages/min), scraped 1972 items (at 5 items/min) 2025-11-08 12:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-10-thermal-transfer-labels-3-core-nonperforated-purple-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-yellow-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-1-sheet-labels-blockout-191.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-sheet-labels-blockout-99.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-grape-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:45 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 12:03:45 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/4-x-4-direct-thermal-labels-3-core-nonperforated-top-coated.html>: HTTP status code is not handled or not allowed 2025-11-08 12:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-8-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-nonperforated-polypropylene-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-nonperforated-brown-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-nonperforated-yellow.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-13-thermal-transfer-labels-3-core-nonperforated-purple-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 3978 pages (at 12 pages/min), scraped 1979 items (at 7 items/min) 2025-11-08 12:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4018 pages (at 40 pages/min), scraped 1998 items (at 19 items/min) 2025-11-08 12:05:10 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 12:05:11 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:2 2025-11-08 12:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4057 pages (at 39 pages/min), scraped 2013 items (at 15 items/min) 2025-11-08 12:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4098 pages (at 41 pages/min), scraped 2035 items (at 22 items/min) 2025-11-08 12:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4138 pages (at 40 pages/min), scraped 2058 items (at 23 items/min) 2025-11-08 12:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-1-75-sheet-labels-turquoise-860.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4175 pages (at 37 pages/min), scraped 2078 items (at 20 items/min) 2025-11-08 12:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-0-666-sheet-labels-turquoise-891.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-0-5-sheet-labels-white-polyester-55.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-5-sheet-labels-white-polyester-104.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-white-polyester-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-white-polyester-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-white-polyester-874.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-1-25-sheet-labels-white-vinyl-drum-192.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-2-6875-sheet-labels-white-vinyl-drum-650.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-75-x-1-75-sheet-labels-turquoise-860.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-white-vinyl-drum-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-white-vinyl-drum-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-33-x-2-sheet-labels-pastel-pink-109.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-white-polyester-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-white-polyester-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-1-25-sheet-labels-white-vinyl-drum-192.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4190 pages (at 15 pages/min), scraped 2082 items (at 4 items/min) 2025-11-08 12:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5625-sheet-labels-white-vinyl-drum-785.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-2-sheet-labels-pastel-pink-175.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-white-polyester-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-pink-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-64-x-0-42-sheet-labels-pastel-pink-620.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4204 pages (at 14 pages/min), scraped 2087 items (at 5 items/min) 2025-11-08 12:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-sheet-labels-pastel-pink-877.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-pink-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-purple-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-pastel-purple-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-white-polyester-875.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4218 pages (at 14 pages/min), scraped 2095 items (at 8 items/min) 2025-11-08 12:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-3-66-sheet-labels-pastel-purple-290.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-5-x-2-0875-sheet-labels-pastel-purple-435.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-375-x-1-4375-sheet-labels-pastel-purple-520.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-5-x-5-5-sheet-labels-pastel-purple-41.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-3125-sheet-labels-pastel-purple-655.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:40 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 12:12:40 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831TU>: HTTP status code is not handled or not allowed 2025-11-08 12:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-3-66-sheet-labels-pastel-purple-290.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-5-x-2-0875-sheet-labels-pastel-purple-435.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4233 pages (at 15 pages/min), scraped 2103 items (at 8 items/min) 2025-11-08 12:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-375-x-1-4375-sheet-labels-pastel-purple-520.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4271 pages (at 38 pages/min), scraped 2124 items (at 21 items/min) 2025-11-08 12:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4313 pages (at 42 pages/min), scraped 2144 items (at 20 items/min) 2025-11-08 12:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4352 pages (at 39 pages/min), scraped 2162 items (at 18 items/min) 2025-11-08 12:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4392 pages (at 40 pages/min), scraped 2182 items (at 20 items/min) 2025-11-08 12:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4432 pages (at 40 pages/min), scraped 2203 items (at 21 items/min) 2025-11-08 12:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40100APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40130APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-LTGN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4472 pages (at 40 pages/min), scraped 2224 items (at 21 items/min) 2025-11-08 12:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*160*200*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S927BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4512 pages (at 40 pages/min), scraped 2244 items (at 20 items/min) 2025-11-08 12:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-G already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4025-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4552 pages (at 40 pages/min), scraped 2263 items (at 19 items/min) 2025-11-08 12:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4592 pages (at 40 pages/min), scraped 2282 items (at 19 items/min) 2025-11-08 12:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4629 pages (at 37 pages/min), scraped 2302 items (at 20 items/min) 2025-11-08 12:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4673 pages (at 44 pages/min), scraped 2325 items (at 23 items/min) 2025-11-08 12:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4711 pages (at 38 pages/min), scraped 2342 items (at 17 items/min) 2025-11-08 12:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4751 pages (at 40 pages/min), scraped 2362 items (at 20 items/min) 2025-11-08 12:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4789 pages (at 38 pages/min), scraped 2382 items (at 20 items/min) 2025-11-08 12:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4827 pages (at 38 pages/min), scraped 2400 items (at 18 items/min) 2025-11-08 12:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4869 pages (at 42 pages/min), scraped 2422 items (at 22 items/min) 2025-11-08 12:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4910 pages (at 41 pages/min), scraped 2442 items (at 20 items/min) 2025-11-08 12:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4953 pages (at 43 pages/min), scraped 2464 items (at 22 items/min) 2025-11-08 12:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 4990 pages (at 37 pages/min), scraped 2482 items (at 18 items/min) 2025-11-08 12:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5029 pages (at 39 pages/min), scraped 2501 items (at 19 items/min) 2025-11-08 12:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-5-sheet-labels-fluorescent-blue-104.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-blue-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-fluorescent-blue-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-fluorescent-blue-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-gold-foil-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-5-sheet-labels-fluorescent-blue-104.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-0-75-sheet-labels-gold-foil-189.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-blue-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5046 pages (at 17 pages/min), scraped 2509 items (at 8 items/min) 2025-11-08 12:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-gold-foil-70.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-gold-foil-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-gold-foil-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-0-75-sheet-labels-gold-foil-189.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-blue-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-25-x-3-25-sheet-labels-gold-foil-862.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-2-sheet-labels-gold-foil-735.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-gold-foil-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5060 pages (at 14 pages/min), scraped 2516 items (at 7 items/min) 2025-11-08 12:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-blue-136.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-25-x-3-25-sheet-labels-gold-foil-862.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-4375-x-0-667-sheet-labels-silver-foil-126.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-silver-foil-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-375-sheet-labels-silver-foil-285.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-gold-foil-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1875-x-1-sheet-labels-silver-foil-365.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-25-x-3-25-sheet-labels-gold-foil-862.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-silver-foil-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-3-5-sheet-labels-silver-foil-525.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-silver-foil-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5078 pages (at 18 pages/min), scraped 2527 items (at 11 items/min) 2025-11-08 12:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-silver-foil-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/7-5-x-0-75-sheet-labels-silver-foil-864.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-gold-foil-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/fanfold-4-x-7-thermal-transfer-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-25-x-3-25-sheet-labels-gold-foil-862.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-label-kit.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-silver-foil-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-silver-foil-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1494-x-3-3072-sheet-labels-gold-foil-828.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-x-5-sheet-labels-206.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/fanfold-4-x-7-thermal-transfer-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5094 pages (at 16 pages/min), scraped 2533 items (at 6 items/min) 2025-11-08 12:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-label-kit.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-25-x-3-25-sheet-labels-gold-foil-862.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-2-6875-sheet-labels-650.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-silver-foil-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-silver-foil-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-KIT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5124 pages (at 30 pages/min), scraped 2547 items (at 14 items/min) 2025-11-08 12:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5162 pages (at 38 pages/min), scraped 2568 items (at 21 items/min) 2025-11-08 12:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-grape-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-thermal-transfer-labels-1-core-fluorescent-green-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-3-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-3-thermal-transfer-labels-3-core-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5193 pages (at 31 pages/min), scraped 2586 items (at 18 items/min) 2025-11-08 12:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5233 pages (at 40 pages/min), scraped 2605 items (at 19 items/min) 2025-11-08 12:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5271 pages (at 38 pages/min), scraped 2621 items (at 16 items/min) 2025-11-08 12:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5310 pages (at 39 pages/min), scraped 2641 items (at 20 items/min) 2025-11-08 12:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5351 pages (at 41 pages/min), scraped 2663 items (at 22 items/min) 2025-11-08 12:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5390 pages (at 39 pages/min), scraped 2683 items (at 20 items/min) 2025-11-08 12:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5431 pages (at 41 pages/min), scraped 2703 items (at 20 items/min) 2025-11-08 12:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5466 pages (at 35 pages/min), scraped 2717 items (at 14 items/min) 2025-11-08 12:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-11-sheet-labels-pastel-purple-93.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-purple-133.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-purple-142.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-11-sheet-labels-pastel-purple-93.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-pastel-purple-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5485 pages (at 19 pages/min), scraped 2730 items (at 13 items/min) 2025-11-08 12:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-purple-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-375-x-1-25-sheet-labels-pastel-purple-884.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-pastel-blue-75.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-blue-88.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-5-sheet-labels-pastel-blue-205.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-x-5-sheet-labels-pastel-blue-206.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-pastel-purple-142.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-11-sheet-labels-pastel-purple-93.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-purple-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-pastel-blue-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-pastel-blue-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-75-x-2-sheet-labels-pastel-blue-730.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-sheet-labels-pastel-blue-770.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-625-x-4-625-sheet-labels-pastel-blue-75.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-5-sheet-labels-pastel-blue-205.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-x-5-sheet-labels-pastel-blue-206.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-blue-88.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5501 pages (at 16 pages/min), scraped 2740 items (at 10 items/min) 2025-11-08 12:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-pastel-green-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-11-sheet-labels-pastel-purple-93.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-purple-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/10-6-x-1-18-sheet-labels-pastel-green-82.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-pastel-blue-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-2-sheet-labels-pastel-green-87.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-green-100.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-sheet-labels-pastel-blue-770.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-5-sheet-labels-pastel-blue-205.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-4-sheet-labels-pastel-blue-88.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-33-x-2-sheet-labels-pastel-green-109.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-purple-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/10-6-x-1-18-sheet-labels-pastel-green-82.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-2-sheet-labels-pastel-green-87.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-pastel-blue-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5513 pages (at 12 pages/min), scraped 2743 items (at 3 items/min) 2025-11-08 12:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-pastel-green-100.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:37 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 12:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-25-x-0-75-sheet-labels-pastel-purple-515.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:37 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/4-5-x-4-5-sheet-labels-pastel-purple-113.html>: HTTP status code is not handled or not allowed 2025-11-08 12:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-2-375-sheet-labels-pastel-blue-685.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:03 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 12:51:03 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/3-875-x-3-875-sheet-labels-pastel-purple-395.html>: HTTP status code is not handled or not allowed 2025-11-08 12:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-pastel-blue-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5530 pages (at 17 pages/min), scraped 2751 items (at 8 items/min) 2025-11-08 12:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/0-75-x-0-75-sheet-labels-pastel-green-184.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5566 pages (at 36 pages/min), scraped 2767 items (at 16 items/min) 2025-11-08 12:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5607 pages (at 41 pages/min), scraped 2789 items (at 22 items/min) 2025-11-08 12:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5645 pages (at 38 pages/min), scraped 2811 items (at 22 items/min) 2025-11-08 12:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5684 pages (at 39 pages/min), scraped 2829 items (at 18 items/min) 2025-11-08 12:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5724 pages (at 40 pages/min), scraped 2846 items (at 17 items/min) 2025-11-08 12:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3050APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5764 pages (at 40 pages/min), scraped 2866 items (at 20 items/min) 2025-11-08 12:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S929BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5804 pages (at 40 pages/min), scraped 2889 items (at 23 items/min) 2025-11-08 12:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0008 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFD4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5846 pages (at 42 pages/min), scraped 2911 items (at 22 items/min) 2025-11-08 12:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4080-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT6040-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3535AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 12:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4012AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5884 pages (at 38 pages/min), scraped 2929 items (at 18 items/min) 2025-11-08 13:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5921 pages (at 37 pages/min), scraped 2944 items (at 15 items/min) 2025-11-08 13:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4090AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 5960 pages (at 39 pages/min), scraped 2965 items (at 21 items/min) 2025-11-08 13:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6003 pages (at 43 pages/min), scraped 2988 items (at 23 items/min) 2025-11-08 13:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:47 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 13:03:48 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:3 2025-11-08 13:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6041 pages (at 38 pages/min), scraped 3009 items (at 21 items/min) 2025-11-08 13:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-57-x-4-57-sheet-labels-crystal-clear-545.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-875-x-2-6875-sheet-labels-crystal-clear-650.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-5-sheet-labels-crystal-clear-770.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-crystal-clear-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-33-sheet-labels-red-50.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6074 pages (at 33 pages/min), scraped 3022 items (at 13 items/min) 2025-11-08 13:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6114 pages (at 40 pages/min), scraped 3041 items (at 19 items/min) 2025-11-08 13:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6151 pages (at 37 pages/min), scraped 3062 items (at 21 items/min) 2025-11-08 13:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6190 pages (at 39 pages/min), scraped 3083 items (at 21 items/min) 2025-11-08 13:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6229 pages (at 39 pages/min), scraped 3099 items (at 16 items/min) 2025-11-08 13:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-2-sheet-labels-pastel-yellow-610.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6264 pages (at 35 pages/min), scraped 3115 items (at 16 items/min) 2025-11-08 13:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-x-5-sheet-labels-pastel-tan-206.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-x-3-5-sheet-labels-pastel-tan-525.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6299 pages (at 35 pages/min), scraped 3134 items (at 19 items/min) 2025-11-08 13:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6335 pages (at 36 pages/min), scraped 3155 items (at 21 items/min) 2025-11-08 13:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6377 pages (at 42 pages/min), scraped 3176 items (at 21 items/min) 2025-11-08 13:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6417 pages (at 40 pages/min), scraped 3194 items (at 18 items/min) 2025-11-08 13:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2015APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4000APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0600*1345*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6090APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9304 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6455 pages (at 38 pages/min), scraped 3211 items (at 17 items/min) 2025-11-08 13:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLGREEN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP*Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6493 pages (at 38 pages/min), scraped 3233 items (at 22 items/min) 2025-11-08 13:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4012-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6530 pages (at 37 pages/min), scraped 3253 items (at 20 items/min) 2025-11-08 13:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4065-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6571 pages (at 41 pages/min), scraped 3272 items (at 19 items/min) 2025-11-08 13:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6610 pages (at 39 pages/min), scraped 3288 items (at 16 items/min) 2025-11-08 13:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6646 pages (at 36 pages/min), scraped 3308 items (at 20 items/min) 2025-11-08 13:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6686 pages (at 40 pages/min), scraped 3331 items (at 23 items/min) 2025-11-08 13:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6724 pages (at 38 pages/min), scraped 3349 items (at 18 items/min) 2025-11-08 13:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6764 pages (at 40 pages/min), scraped 3367 items (at 18 items/min) 2025-11-08 13:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6803 pages (at 39 pages/min), scraped 3385 items (at 18 items/min) 2025-11-08 13:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6843 pages (at 40 pages/min), scraped 3408 items (at 23 items/min) 2025-11-08 13:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6880 pages (at 37 pages/min), scraped 3429 items (at 21 items/min) 2025-11-08 13:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6920 pages (at 40 pages/min), scraped 3446 items (at 17 items/min) 2025-11-08 13:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6961 pages (at 41 pages/min), scraped 3464 items (at 18 items/min) 2025-11-08 13:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 6999 pages (at 38 pages/min), scraped 3485 items (at 21 items/min) 2025-11-08 13:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7036 pages (at 37 pages/min), scraped 3507 items (at 22 items/min) 2025-11-08 13:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7076 pages (at 40 pages/min), scraped 3525 items (at 18 items/min) 2025-11-08 13:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1182*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-DKB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9306 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S903BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S904AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S909BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7114 pages (at 38 pages/min), scraped 3541 items (at 16 items/min) 2025-11-08 13:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S912BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSI0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7152 pages (at 38 pages/min), scraped 3560 items (at 19 items/min) 2025-11-08 13:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7195 pages (at 43 pages/min), scraped 3583 items (at 23 items/min) 2025-11-08 13:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7231 pages (at 36 pages/min), scraped 3605 items (at 22 items/min) 2025-11-08 13:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7272 pages (at 41 pages/min), scraped 3622 items (at 17 items/min) 2025-11-08 13:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7312 pages (at 40 pages/min), scraped 3638 items (at 16 items/min) 2025-11-08 13:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7350 pages (at 38 pages/min), scraped 3660 items (at 22 items/min) 2025-11-08 13:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7389 pages (at 39 pages/min), scraped 3683 items (at 23 items/min) 2025-11-08 13:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7429 pages (at 40 pages/min), scraped 3702 items (at 19 items/min) 2025-11-08 13:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7469 pages (at 40 pages/min), scraped 3718 items (at 16 items/min) 2025-11-08 13:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7507 pages (at 38 pages/min), scraped 3737 items (at 19 items/min) 2025-11-08 13:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7546 pages (at 39 pages/min), scraped 3760 items (at 23 items/min) 2025-11-08 13:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7587 pages (at 41 pages/min), scraped 3782 items (at 22 items/min) 2025-11-08 13:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7625 pages (at 38 pages/min), scraped 3799 items (at 17 items/min) 2025-11-08 13:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7664 pages (at 39 pages/min), scraped 3815 items (at 16 items/min) 2025-11-08 13:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7705 pages (at 41 pages/min), scraped 3837 items (at 22 items/min) 2025-11-08 13:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7744 pages (at 39 pages/min), scraped 3860 items (at 23 items/min) 2025-11-08 13:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0433*1345*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0600*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7784 pages (at 40 pages/min), scraped 3879 items (at 19 items/min) 2025-11-08 13:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S901AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S370WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S920BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7822 pages (at 38 pages/min), scraped 3896 items (at 17 items/min) 2025-11-08 13:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7860 pages (at 38 pages/min), scraped 3914 items (at 18 items/min) 2025-11-08 13:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7898 pages (at 38 pages/min), scraped 3935 items (at 21 items/min) 2025-11-08 13:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7937 pages (at 39 pages/min), scraped 3957 items (at 22 items/min) 2025-11-08 13:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 7976 pages (at 39 pages/min), scraped 3974 items (at 17 items/min) 2025-11-08 13:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8014 pages (at 38 pages/min), scraped 3990 items (at 16 items/min) 2025-11-08 13:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:28 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 13:55:29 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:4 2025-11-08 13:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8051 pages (at 37 pages/min), scraped 4011 items (at 21 items/min) 2025-11-08 13:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8091 pages (at 40 pages/min), scraped 4034 items (at 23 items/min) 2025-11-08 13:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8127 pages (at 36 pages/min), scraped 4050 items (at 16 items/min) 2025-11-08 13:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-red-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8167 pages (at 40 pages/min), scraped 4068 items (at 18 items/min) 2025-11-08 13:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 13:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8205 pages (at 38 pages/min), scraped 4087 items (at 19 items/min) 2025-11-08 14:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8240 pages (at 35 pages/min), scraped 4108 items (at 21 items/min) 2025-11-08 14:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8282 pages (at 42 pages/min), scraped 4129 items (at 21 items/min) 2025-11-08 14:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8322 pages (at 40 pages/min), scraped 4147 items (at 18 items/min) 2025-11-08 14:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8361 pages (at 39 pages/min), scraped 4164 items (at 17 items/min) 2025-11-08 14:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8400 pages (at 39 pages/min), scraped 4185 items (at 21 items/min) 2025-11-08 14:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8437 pages (at 37 pages/min), scraped 4207 items (at 22 items/min) 2025-11-08 14:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0400*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4080APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=E*0433*245*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8475 pages (at 38 pages/min), scraped 4224 items (at 17 items/min) 2025-11-08 14:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT1510AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8514 pages (at 39 pages/min), scraped 4241 items (at 17 items/min) 2025-11-08 14:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-G already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8553 pages (at 39 pages/min), scraped 4260 items (at 19 items/min) 2025-11-08 14:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8588 pages (at 35 pages/min), scraped 4282 items (at 22 items/min) 2025-11-08 14:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4025AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8630 pages (at 42 pages/min), scraped 4302 items (at 20 items/min) 2025-11-08 14:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8670 pages (at 40 pages/min), scraped 4320 items (at 18 items/min) 2025-11-08 14:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8709 pages (at 39 pages/min), scraped 4339 items (at 19 items/min) 2025-11-08 14:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8751 pages (at 42 pages/min), scraped 4359 items (at 20 items/min) 2025-11-08 14:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8790 pages (at 39 pages/min), scraped 4383 items (at 24 items/min) 2025-11-08 14:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8828 pages (at 38 pages/min), scraped 4402 items (at 19 items/min) 2025-11-08 14:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8869 pages (at 41 pages/min), scraped 4418 items (at 16 items/min) 2025-11-08 14:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8907 pages (at 38 pages/min), scraped 4438 items (at 20 items/min) 2025-11-08 14:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8946 pages (at 39 pages/min), scraped 4459 items (at 21 items/min) 2025-11-08 14:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 8987 pages (at 41 pages/min), scraped 4482 items (at 23 items/min) 2025-11-08 14:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9026 pages (at 39 pages/min), scraped 4500 items (at 18 items/min) 2025-11-08 14:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4025APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9068 pages (at 42 pages/min), scraped 4518 items (at 18 items/min) 2025-11-08 14:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4070APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=D*0400*1182*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0327*1476*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-CHA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLRED-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT225125AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9105 pages (at 37 pages/min), scraped 4537 items (at 19 items/min) 2025-11-08 14:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9147 pages (at 42 pages/min), scraped 4559 items (at 22 items/min) 2025-11-08 14:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4040-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9182 pages (at 35 pages/min), scraped 4579 items (at 20 items/min) 2025-11-08 14:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9222 pages (at 40 pages/min), scraped 4595 items (at 16 items/min) 2025-11-08 14:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4065AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9262 pages (at 40 pages/min), scraped 4615 items (at 20 items/min) 2025-11-08 14:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9303 pages (at 41 pages/min), scraped 4636 items (at 21 items/min) 2025-11-08 14:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9344 pages (at 41 pages/min), scraped 4660 items (at 24 items/min) 2025-11-08 14:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9384 pages (at 40 pages/min), scraped 4680 items (at 20 items/min) 2025-11-08 14:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9424 pages (at 40 pages/min), scraped 4698 items (at 18 items/min) 2025-11-08 14:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9463 pages (at 39 pages/min), scraped 4716 items (at 18 items/min) 2025-11-08 14:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9507 pages (at 44 pages/min), scraped 4738 items (at 22 items/min) 2025-11-08 14:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9546 pages (at 39 pages/min), scraped 4760 items (at 22 items/min) 2025-11-08 14:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9585 pages (at 39 pages/min), scraped 4780 items (at 20 items/min) 2025-11-08 14:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9625 pages (at 40 pages/min), scraped 4798 items (at 18 items/min) 2025-11-08 14:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9665 pages (at 40 pages/min), scraped 4817 items (at 19 items/min) 2025-11-08 14:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9705 pages (at 40 pages/min), scraped 4838 items (at 21 items/min) 2025-11-08 14:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0327*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-HOTPNK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9401 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-laser-sheet-label.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9743 pages (at 38 pages/min), scraped 4859 items (at 21 items/min) 2025-11-08 14:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S380WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S926AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S919DD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-DARKBLUE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-POLY-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-HOTPINK-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9783 pages (at 40 pages/min), scraped 4878 items (at 19 items/min) 2025-11-08 14:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0006 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2312540A-DYMO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-625-inch-x-2-0625-inch-blank-mettler-toledo-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-13-direct-thermal-labels-3-core-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-1-5-thermal-transfer-labels-3-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-thermal-transfer-labels-1-core-fluorescent-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT2312540A-DYMO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9811 pages (at 28 pages/min), scraped 4891 items (at 13 items/min) 2025-11-08 14:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-1-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-fanfold-labels-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-625-inch-x-2-0625-inch-blank-mettler-toledo-labels.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4013A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-nonperforated-fluorescent-green-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9843 pages (at 32 pages/min), scraped 4908 items (at 17 items/min) 2025-11-08 14:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9884 pages (at 41 pages/min), scraped 4927 items (at 19 items/min) 2025-11-08 14:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9924 pages (at 40 pages/min), scraped 4946 items (at 19 items/min) 2025-11-08 14:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 9963 pages (at 39 pages/min), scraped 4967 items (at 21 items/min) 2025-11-08 14:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10003 pages (at 40 pages/min), scraped 4987 items (at 20 items/min) 2025-11-08 14:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:49 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 14:46:50 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:5 2025-11-08 14:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10042 pages (at 39 pages/min), scraped 5007 items (at 20 items/min) 2025-11-08 14:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10078 pages (at 36 pages/min), scraped 5023 items (at 16 items/min) 2025-11-08 14:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10118 pages (at 40 pages/min), scraped 5044 items (at 21 items/min) 2025-11-08 14:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10157 pages (at 39 pages/min), scraped 5064 items (at 20 items/min) 2025-11-08 14:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10197 pages (at 40 pages/min), scraped 5084 items (at 20 items/min) 2025-11-08 14:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10239 pages (at 42 pages/min), scraped 5105 items (at 21 items/min) 2025-11-08 14:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10276 pages (at 37 pages/min), scraped 5123 items (at 18 items/min) 2025-11-08 14:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10316 pages (at 40 pages/min), scraped 5144 items (at 21 items/min) 2025-11-08 14:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10356 pages (at 40 pages/min), scraped 5164 items (at 20 items/min) 2025-11-08 14:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG5030APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-FLGRN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*200*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10397 pages (at 41 pages/min), scraped 5184 items (at 20 items/min) 2025-11-08 14:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*160*300*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*300*110*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9503 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S921CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4060 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10434 pages (at 37 pages/min), scraped 5202 items (at 18 items/min) 2025-11-08 14:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2515AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10472 pages (at 38 pages/min), scraped 5222 items (at 20 items/min) 2025-11-08 14:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10512 pages (at 40 pages/min), scraped 5242 items (at 20 items/min) 2025-11-08 14:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4015AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 14:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10552 pages (at 40 pages/min), scraped 5262 items (at 20 items/min) 2025-11-08 15:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT5030AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10595 pages (at 43 pages/min), scraped 5283 items (at 21 items/min) 2025-11-08 15:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10632 pages (at 37 pages/min), scraped 5302 items (at 19 items/min) 2025-11-08 15:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10670 pages (at 38 pages/min), scraped 5321 items (at 19 items/min) 2025-11-08 15:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10710 pages (at 40 pages/min), scraped 5340 items (at 19 items/min) 2025-11-08 15:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10749 pages (at 39 pages/min), scraped 5360 items (at 20 items/min) 2025-11-08 15:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10786 pages (at 37 pages/min), scraped 5378 items (at 18 items/min) 2025-11-08 15:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10826 pages (at 40 pages/min), scraped 5398 items (at 20 items/min) 2025-11-08 15:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10865 pages (at 39 pages/min), scraped 5419 items (at 21 items/min) 2025-11-08 15:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10904 pages (at 39 pages/min), scraped 5438 items (at 19 items/min) 2025-11-08 15:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10943 pages (at 39 pages/min), scraped 5456 items (at 18 items/min) 2025-11-08 15:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 10981 pages (at 38 pages/min), scraped 5476 items (at 20 items/min) 2025-11-08 15:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11020 pages (at 39 pages/min), scraped 5497 items (at 21 items/min) 2025-11-08 15:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11060 pages (at 40 pages/min), scraped 5516 items (at 19 items/min) 2025-11-08 15:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4090APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-0-75-sheet-labels-220.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1875-x-1-sheet-labels-365.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-sheet-labels-500.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-78-x-4-75-sheet-labels-848.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4090APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLORANGE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GREEN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-thermal-transfer-labels-3-core-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11090 pages (at 30 pages/min), scraped 5530 items (at 14 items/min) 2025-11-08 15:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-1-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11121 pages (at 31 pages/min), scraped 5547 items (at 17 items/min) 2025-11-08 15:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-12-thermal-transfer-fanfold-labels-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-sensor-75-core.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-thermal-transfer-labels-3-core-brown.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-thermal-transfer-labels-1-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-6-thermal-transfer-labels-3-core-fluorescent-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11142 pages (at 21 pages/min), scraped 5555 items (at 8 items/min) 2025-11-08 15:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-fanfold-labels-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-1-direct-thermal-labels-3-core-top-coated.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-red-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-5-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-10-thermal-transfer-labels-3-core-nonperforated-orange-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-7-thermal-transfer-fanfold-labels-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11157 pages (at 15 pages/min), scraped 5563 items (at 8 items/min) 2025-11-08 15:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-4-thermal-transfer-labels-3-core-green.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-red-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-5-thermal-transfer-fanfold-labels-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-fanfold-labels-red.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:58 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 15:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-red-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:17:58 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365W>: HTTP status code is not handled or not allowed 2025-11-08 15:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11170 pages (at 13 pages/min), scraped 5566 items (at 3 items/min) 2025-11-08 15:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:29 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 15:18:29 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BLOCKOUT>: HTTP status code is not handled or not allowed 2025-11-08 15:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-red-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-gray.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:46 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 15:18:46 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AF-XL>: HTTP status code is not handled or not allowed 2025-11-08 15:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:03 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 15:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:03 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-FLGREEN>: HTTP status code is not handled or not allowed 2025-11-08 15:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-thermal-transfer-labels-3-core-nonperforated-red-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5-x-3-5-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11186 pages (at 16 pages/min), scraped 5574 items (at 8 items/min) 2025-11-08 15:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/7-x-0-75-sheet-labels-blockout-29.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-thermal-transfer-labels-3-core-nonperforated-hot-pink.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11221 pages (at 35 pages/min), scraped 5593 items (at 19 items/min) 2025-11-08 15:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11261 pages (at 40 pages/min), scraped 5613 items (at 20 items/min) 2025-11-08 15:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11301 pages (at 40 pages/min), scraped 5632 items (at 19 items/min) 2025-11-08 15:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11340 pages (at 39 pages/min), scraped 5650 items (at 18 items/min) 2025-11-08 15:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11380 pages (at 40 pages/min), scraped 5671 items (at 21 items/min) 2025-11-08 15:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11421 pages (at 41 pages/min), scraped 5693 items (at 22 items/min) 2025-11-08 15:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11457 pages (at 36 pages/min), scraped 5711 items (at 18 items/min) 2025-11-08 15:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11500 pages (at 43 pages/min), scraped 5730 items (at 19 items/min) 2025-11-08 15:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11539 pages (at 39 pages/min), scraped 5750 items (at 20 items/min) 2025-11-08 15:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11578 pages (at 39 pages/min), scraped 5771 items (at 21 items/min) 2025-11-08 15:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11617 pages (at 39 pages/min), scraped 5791 items (at 20 items/min) 2025-11-08 15:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11658 pages (at 41 pages/min), scraped 5811 items (at 20 items/min) 2025-11-08 15:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11697 pages (at 39 pages/min), scraped 5829 items (at 18 items/min) 2025-11-08 15:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP*2 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAPE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4065AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0014 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11735 pages (at 38 pages/min), scraped 5848 items (at 19 items/min) 2025-11-08 15:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4012AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11775 pages (at 40 pages/min), scraped 5870 items (at 22 items/min) 2025-11-08 15:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11812 pages (at 37 pages/min), scraped 5888 items (at 18 items/min) 2025-11-08 15:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11853 pages (at 41 pages/min), scraped 5907 items (at 19 items/min) 2025-11-08 15:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11894 pages (at 41 pages/min), scraped 5929 items (at 22 items/min) 2025-11-08 15:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11931 pages (at 37 pages/min), scraped 5946 items (at 17 items/min) 2025-11-08 15:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 11974 pages (at 43 pages/min), scraped 5970 items (at 24 items/min) 2025-11-08 15:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12016 pages (at 42 pages/min), scraped 5991 items (at 21 items/min) 2025-11-08 15:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:41 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 15:40:42 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:6 2025-11-08 15:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12058 pages (at 42 pages/min), scraped 6011 items (at 20 items/min) 2025-11-08 15:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12097 pages (at 39 pages/min), scraped 6029 items (at 18 items/min) 2025-11-08 15:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12135 pages (at 38 pages/min), scraped 6048 items (at 19 items/min) 2025-11-08 15:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12177 pages (at 42 pages/min), scraped 6070 items (at 22 items/min) 2025-11-08 15:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12217 pages (at 40 pages/min), scraped 6091 items (at 21 items/min) 2025-11-08 15:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12259 pages (at 42 pages/min), scraped 6112 items (at 21 items/min) 2025-11-08 15:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12296 pages (at 37 pages/min), scraped 6128 items (at 16 items/min) 2025-11-08 15:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12335 pages (at 39 pages/min), scraped 6148 items (at 20 items/min) 2025-11-08 15:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4020APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3060APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3580APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=E*0433*244*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12372 pages (at 37 pages/min), scraped 6169 items (at 21 items/min) 2025-11-08 15:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-CHARTREUSE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6040AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12411 pages (at 39 pages/min), scraped 6188 items (at 19 items/min) 2025-11-08 15:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12452 pages (at 41 pages/min), scraped 6208 items (at 20 items/min) 2025-11-08 15:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4030-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12490 pages (at 38 pages/min), scraped 6225 items (at 17 items/min) 2025-11-08 15:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12530 pages (at 40 pages/min), scraped 6246 items (at 21 items/min) 2025-11-08 15:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12566 pages (at 36 pages/min), scraped 6265 items (at 19 items/min) 2025-11-08 15:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-656-x-4-656-sheet-labels-white-premium-high-gloss-35.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-656-x-4-656-sheet-labels-white-premium-high-gloss-97.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-sheet-labels-white-premium-high-gloss-99.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12600 pages (at 34 pages/min), scraped 6283 items (at 18 items/min) 2025-11-08 15:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12643 pages (at 43 pages/min), scraped 6304 items (at 21 items/min) 2025-11-08 15:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12684 pages (at 41 pages/min), scraped 6323 items (at 19 items/min) 2025-11-08 15:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12723 pages (at 39 pages/min), scraped 6342 items (at 19 items/min) 2025-11-08 15:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12762 pages (at 39 pages/min), scraped 6362 items (at 20 items/min) 2025-11-08 15:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 15:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12802 pages (at 40 pages/min), scraped 6383 items (at 21 items/min) 2025-11-08 16:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12841 pages (at 39 pages/min), scraped 6402 items (at 19 items/min) 2025-11-08 16:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12881 pages (at 40 pages/min), scraped 6421 items (at 19 items/min) 2025-11-08 16:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12919 pages (at 38 pages/min), scraped 6440 items (at 19 items/min) 2025-11-08 16:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12960 pages (at 41 pages/min), scraped 6462 items (at 22 items/min) 2025-11-08 16:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 12999 pages (at 39 pages/min), scraped 6483 items (at 21 items/min) 2025-11-08 16:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13040 pages (at 41 pages/min), scraped 6502 items (at 19 items/min) 2025-11-08 16:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2010APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG2515APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4015APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-B already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9504 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTAG4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13078 pages (at 38 pages/min), scraped 6518 items (at 16 items/min) 2025-11-08 16:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S907GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-BROWN-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4065 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13117 pages (at 39 pages/min), scraped 6539 items (at 21 items/min) 2025-11-08 16:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDPF4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13157 pages (at 40 pages/min), scraped 6561 items (at 22 items/min) 2025-11-08 16:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13196 pages (at 39 pages/min), scraped 6581 items (at 20 items/min) 2025-11-08 16:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13234 pages (at 38 pages/min), scraped 6597 items (at 16 items/min) 2025-11-08 16:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13273 pages (at 39 pages/min), scraped 6618 items (at 21 items/min) 2025-11-08 16:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13314 pages (at 41 pages/min), scraped 6639 items (at 21 items/min) 2025-11-08 16:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13352 pages (at 38 pages/min), scraped 6659 items (at 20 items/min) 2025-11-08 16:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13392 pages (at 40 pages/min), scraped 6676 items (at 17 items/min) 2025-11-08 16:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13431 pages (at 39 pages/min), scraped 6694 items (at 18 items/min) 2025-11-08 16:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13467 pages (at 36 pages/min), scraped 6715 items (at 21 items/min) 2025-11-08 16:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13506 pages (at 39 pages/min), scraped 6736 items (at 21 items/min) 2025-11-08 16:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13544 pages (at 38 pages/min), scraped 6754 items (at 18 items/min) 2025-11-08 16:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13582 pages (at 38 pages/min), scraped 6771 items (at 17 items/min) 2025-11-08 16:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13622 pages (at 40 pages/min), scraped 6791 items (at 20 items/min) 2025-11-08 16:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3020APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4030APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13661 pages (at 39 pages/min), scraped 6812 items (at 21 items/min) 2025-11-08 16:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTPF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-RED-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FDT4020 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0008 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13698 pages (at 37 pages/min), scraped 6832 items (at 20 items/min) 2025-11-08 16:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3010AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13737 pages (at 39 pages/min), scraped 6849 items (at 17 items/min) 2025-11-08 16:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13779 pages (at 42 pages/min), scraped 6869 items (at 20 items/min) 2025-11-08 16:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13819 pages (at 40 pages/min), scraped 6890 items (at 21 items/min) 2025-11-08 16:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13858 pages (at 39 pages/min), scraped 6911 items (at 21 items/min) 2025-11-08 16:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13898 pages (at 40 pages/min), scraped 6932 items (at 21 items/min) 2025-11-08 16:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S875GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13935 pages (at 37 pages/min), scraped 6949 items (at 17 items/min) 2025-11-08 16:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 13977 pages (at 42 pages/min), scraped 6968 items (at 19 items/min) 2025-11-08 16:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14016 pages (at 39 pages/min), scraped 6990 items (at 22 items/min) 2025-11-08 16:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:42 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 16:31:43 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:7 2025-11-08 16:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14054 pages (at 38 pages/min), scraped 7010 items (at 20 items/min) 2025-11-08 16:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14092 pages (at 38 pages/min), scraped 7027 items (at 17 items/min) 2025-11-08 16:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14133 pages (at 41 pages/min), scraped 7046 items (at 19 items/min) 2025-11-08 16:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14172 pages (at 39 pages/min), scraped 7067 items (at 21 items/min) 2025-11-08 16:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14215 pages (at 43 pages/min), scraped 7089 items (at 22 items/min) 2025-11-08 16:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0238*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=800*190*300*1000*H already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14253 pages (at 38 pages/min), scraped 7109 items (at 20 items/min) 2025-11-08 16:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PINK-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0010 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4060AP-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14293 pages (at 40 pages/min), scraped 7128 items (at 19 items/min) 2025-11-08 16:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT3020AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3030AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14331 pages (at 38 pages/min), scraped 7146 items (at 18 items/min) 2025-11-08 16:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4050AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14371 pages (at 40 pages/min), scraped 7166 items (at 20 items/min) 2025-11-08 16:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4100AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14410 pages (at 39 pages/min), scraped 7187 items (at 21 items/min) 2025-11-08 16:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6090AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14452 pages (at 42 pages/min), scraped 7209 items (at 22 items/min) 2025-11-08 16:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14493 pages (at 41 pages/min), scraped 7229 items (at 20 items/min) 2025-11-08 16:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14535 pages (at 42 pages/min), scraped 7248 items (at 19 items/min) 2025-11-08 16:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14572 pages (at 37 pages/min), scraped 7266 items (at 18 items/min) 2025-11-08 16:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14608 pages (at 36 pages/min), scraped 7287 items (at 21 items/min) 2025-11-08 16:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14648 pages (at 40 pages/min), scraped 7305 items (at 18 items/min) 2025-11-08 16:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14685 pages (at 37 pages/min), scraped 7323 items (at 18 items/min) 2025-11-08 16:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14723 pages (at 38 pages/min), scraped 7343 items (at 20 items/min) 2025-11-08 16:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14762 pages (at 39 pages/min), scraped 7363 items (at 20 items/min) 2025-11-08 16:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14803 pages (at 41 pages/min), scraped 7383 items (at 20 items/min) 2025-11-08 16:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14840 pages (at 37 pages/min), scraped 7401 items (at 18 items/min) 2025-11-08 16:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG225125APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP*2 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=9380 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14880 pages (at 40 pages/min), scraped 7420 items (at 19 items/min) 2025-11-08 16:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S908BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-YELLOW-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT5030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S908BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-thermal-transfer-labels-1-core-blockout.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT5030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-6-direct-thermal-labels-3-core-nonperforated-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14913 pages (at 33 pages/min), scraped 7437 items (at 17 items/min) 2025-11-08 16:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-2-direct-thermal-labels-3-core-nonperforated-top-coated-xl.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14947 pages (at 34 pages/min), scraped 7456 items (at 19 items/min) 2025-11-08 16:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLOCKOUT-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-GRAPE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 14985 pages (at 38 pages/min), scraped 7473 items (at 17 items/min) 2025-11-08 16:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15024 pages (at 39 pages/min), scraped 7493 items (at 20 items/min) 2025-11-08 16:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT5030AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15066 pages (at 42 pages/min), scraped 7513 items (at 20 items/min) 2025-11-08 16:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15107 pages (at 41 pages/min), scraped 7535 items (at 22 items/min) 2025-11-08 16:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 16:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15147 pages (at 40 pages/min), scraped 7556 items (at 21 items/min) 2025-11-08 17:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15187 pages (at 40 pages/min), scraped 7576 items (at 20 items/min) 2025-11-08 17:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15225 pages (at 38 pages/min), scraped 7593 items (at 17 items/min) 2025-11-08 17:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15265 pages (at 40 pages/min), scraped 7613 items (at 20 items/min) 2025-11-08 17:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15304 pages (at 39 pages/min), scraped 7634 items (at 21 items/min) 2025-11-08 17:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15345 pages (at 41 pages/min), scraped 7655 items (at 21 items/min) 2025-11-08 17:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15385 pages (at 40 pages/min), scraped 7675 items (at 20 items/min) 2025-11-08 17:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S191FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S110FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15423 pages (at 38 pages/min), scraped 7691 items (at 16 items/min) 2025-11-08 17:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15463 pages (at 40 pages/min), scraped 7712 items (at 21 items/min) 2025-11-08 17:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG6040APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S910GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S911BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15501 pages (at 38 pages/min), scraped 7733 items (at 21 items/min) 2025-11-08 17:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-GRAY-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-DARKBLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT1510AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSH0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4020AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4040AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT225125AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4025-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15540 pages (at 39 pages/min), scraped 7752 items (at 19 items/min) 2025-11-08 17:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3010AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3100A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15579 pages (at 39 pages/min), scraped 7770 items (at 18 items/min) 2025-11-08 17:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15619 pages (at 40 pages/min), scraped 7789 items (at 19 items/min) 2025-11-08 17:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-YELLOW-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15661 pages (at 42 pages/min), scraped 7812 items (at 23 items/min) 2025-11-08 17:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15698 pages (at 37 pages/min), scraped 7831 items (at 19 items/min) 2025-11-08 17:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15739 pages (at 41 pages/min), scraped 7851 items (at 20 items/min) 2025-11-08 17:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15776 pages (at 37 pages/min), scraped 7869 items (at 18 items/min) 2025-11-08 17:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15814 pages (at 38 pages/min), scraped 7888 items (at 19 items/min) 2025-11-08 17:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S570TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S20VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15855 pages (at 41 pages/min), scraped 7909 items (at 21 items/min) 2025-11-08 17:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S855PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15893 pages (at 38 pages/min), scraped 7928 items (at 19 items/min) 2025-11-08 17:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S275PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15932 pages (at 39 pages/min), scraped 7947 items (at 19 items/min) 2025-11-08 17:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 15971 pages (at 39 pages/min), scraped 7967 items (at 20 items/min) 2025-11-08 17:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S60FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16010 pages (at 39 pages/min), scraped 7986 items (at 19 items/min) 2025-11-08 17:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:46 [py.warnings] (PID: 109) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly. 2025-11-08 17:22:47 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:8 2025-11-08 17:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16050 pages (at 40 pages/min), scraped 8007 items (at 21 items/min) 2025-11-08 17:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16089 pages (at 39 pages/min), scraped 8026 items (at 19 items/min) 2025-11-08 17:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16129 pages (at 40 pages/min), scraped 8046 items (at 20 items/min) 2025-11-08 17:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-PUR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FFT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S865W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S913BB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16170 pages (at 41 pages/min), scraped 8066 items (at 20 items/min) 2025-11-08 17:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4030AF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3020AF-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4020AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4012-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2015AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-SENSOR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT2015AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLUE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16210 pages (at 40 pages/min), scraped 8086 items (at 20 items/min) 2025-11-08 17:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3050AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3535AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16250 pages (at 40 pages/min), scraped 8107 items (at 21 items/min) 2025-11-08 17:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S192ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16289 pages (at 39 pages/min), scraped 8126 items (at 19 items/min) 2025-11-08 17:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16331 pages (at 42 pages/min), scraped 8148 items (at 22 items/min) 2025-11-08 17:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S215GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S126CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S345CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S620CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16371 pages (at 40 pages/min), scraped 8166 items (at 18 items/min) 2025-11-08 17:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S88CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S91CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S165CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S80SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S183SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16410 pages (at 39 pages/min), scraped 8187 items (at 21 items/min) 2025-11-08 17:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S204TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16452 pages (at 42 pages/min), scraped 8208 items (at 21 items/min) 2025-11-08 17:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16490 pages (at 38 pages/min), scraped 8226 items (at 18 items/min) 2025-11-08 17:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S200PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S255PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16531 pages (at 41 pages/min), scraped 8247 items (at 21 items/min) 2025-11-08 17:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S435PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S685PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S862PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16568 pages (at 37 pages/min), scraped 8265 items (at 18 items/min) 2025-11-08 17:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S160PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16605 pages (at 37 pages/min), scraped 8284 items (at 19 items/min) 2025-11-08 17:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S212FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16645 pages (at 40 pages/min), scraped 8304 items (at 20 items/min) 2025-11-08 17:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S490FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S828FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16685 pages (at 40 pages/min), scraped 8324 items (at 20 items/min) 2025-11-08 17:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S465GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S120SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S880SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16725 pages (at 40 pages/min), scraped 8344 items (at 20 items/min) 2025-11-08 17:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG30100APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3510APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG40120APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*985*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0650*1476*W*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=Z*0433*1476*X*BX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S104W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16763 pages (at 38 pages/min), scraped 8362 items (at 18 items/min) 2025-11-08 17:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S810W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S755W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S905GG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETP4060AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060A-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSD0003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT2010AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSB0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4060AP-2X already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4020A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WSC0004 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT225125AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=WST0002 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16802 pages (at 39 pages/min), scraped 8383 items (at 21 items/min) 2025-11-08 17:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4013-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP3010AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-CHARTREUSE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3040AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4080-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3060AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16842 pages (at 40 pages/min), scraped 8402 items (at 19 items/min) 2025-11-08 17:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT3580AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4080AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4012AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-GREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S182OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-ORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S705OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S843OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S871OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16882 pages (at 40 pages/min), scraped 8421 items (at 19 items/min) 2025-11-08 17:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4065AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S115ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4090AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6080AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16922 pages (at 40 pages/min), scraped 8442 items (at 21 items/min) 2025-11-08 17:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S196GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S715GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S775GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 16962 pages (at 40 pages/min), scraped 8463 items (at 21 items/min) 2025-11-08 17:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S203MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S70CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S116CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S848CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17003 pages (at 41 pages/min), scraped 8483 items (at 20 items/min) 2025-11-08 17:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S415CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S90SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S550SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S625SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S112GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S208GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17042 pages (at 39 pages/min), scraped 8502 items (at 19 items/min) 2025-11-08 17:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S95TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S240WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S18VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17078 pages (at 36 pages/min), scraped 8520 items (at 18 items/min) 2025-11-08 17:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S127VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S75PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17119 pages (at 41 pages/min), scraped 8541 items (at 21 items/min) 2025-11-08 17:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S650PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S36PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S125PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S198PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17160 pages (at 41 pages/min), scraped 8562 items (at 21 items/min) 2025-11-08 17:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S890PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S136PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S260PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S495PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S350PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S861PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17198 pages (at 38 pages/min), scraped 8581 items (at 19 items/min) 2025-11-08 17:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S114PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S117BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S217BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S142BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S824BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S210FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S884BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S213FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17239 pages (at 41 pages/min), scraped 8600 items (at 19 items/min) 2025-11-08 17:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S113FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S835FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S93FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17278 pages (at 39 pages/min), scraped 8619 items (at 19 items/min) 2025-11-08 17:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S520FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S590FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S50FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S140FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S205FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17314 pages (at 36 pages/min), scraped 8639 items (at 20 items/min) 2025-11-08 17:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S189FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S209FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S325FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S306FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S44GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S56GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S515GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17353 pages (at 39 pages/min), scraped 8659 items (at 20 items/min) 2025-11-08 17:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S100SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S96SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S470SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S760SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG3535APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=R36IJG4050APM already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4060-Y already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTP4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S10W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S211W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S831W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853W already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S405WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S406WX already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17392 pages (at 39 pages/min), scraped 8677 items (at 18 items/min) 2025-11-08 17:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S902AA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S915CC already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PURPLE-XS already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4040AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4060AP-PURPLE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060AP-ORG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4060AP-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2010AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4060A already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDF4030AP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4080AP-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4020-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4060A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4020AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT3020AP-BLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17430 pages (at 38 pages/min), scraped 8696 items (at 19 items/min) 2025-11-08 17:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2060AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4030-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT2515AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4030AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4010AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=HDT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050A-FLRED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3020AP-FLGREEN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4020AP-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4065-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT4070-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4040AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3050AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-PURPLE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4030A-GRAY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT5030-YELLOW already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3510AP-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17472 pages (at 42 pages/min), scraped 8716 items (at 20 items/min) 2025-11-08 17:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=FTT6040-FLORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040A-RED-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-BLOCKOUT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT4050A-TOP-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT3580AP-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-BROWN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=ETT4065AP-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4000-PINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4010AP-DARKBLUE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080A-RED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=EDT4080AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 17:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4100A-BROWN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLORANGE-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17511 pages (at 39 pages/min), scraped 8737 items (at 21 items/min) 2025-11-08 18:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S839OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-35-sheet-labels-white-matte-litho-103.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-FLGREEN-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4015AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-HOTPINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-white-matte-litho-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-6562-x-2-75-sheet-labels-white-matte-litho-475.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S400ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4025AP-HOTPINK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S655OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S838OP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17533 pages (at 22 pages/min), scraped 8748 items (at 11 items/min) 2025-11-08 18:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-5-thermal-transfer-labels-3-core-orange.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-35-sheet-labels-white-matte-litho-103.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-2-sheet-labels-photo-gloss-45.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-photo-gloss-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-white-matte-litho-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S475ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-sheet-labels-photo-gloss-194.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6040A-POLY-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-sheet-labels-photo-gloss-876.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-0-5-sheet-labels-photo-gloss-883.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-35-sheet-labels-white-matte-litho-103.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-white-mid-gloss-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-8-thermal-transfer-labels-3-core-grape.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-photo-gloss-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-white-matte-litho-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-white-mid-gloss-185.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-5-x-1-5-sheet-labels-photo-gloss-194.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17547 pages (at 14 pages/min), scraped 8757 items (at 9 items/min) 2025-11-08 18:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RDT6060AP-TOP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-white-mid-gloss-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S395MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-4-thermal-transfer-labels-3-core-chartreuse.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-0-5-sheet-labels-photo-gloss-883.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-white-mid-gloss-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S103ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-1-5-sheet-labels-photo-gloss-71.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-white-matte-litho-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-white-mid-gloss-185.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-5-x-4-125-sheet-labels-white-premium-high-gloss-9.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-white-mid-gloss-780.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-1875-x-1-sheet-labels-white-premium-high-gloss-365.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-FLRED already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4040AP-CHARTREUSE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-polypropylene.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4050AP-ORANGE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17562 pages (at 15 pages/min), scraped 8763 items (at 6 items/min) 2025-11-08 18:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-white-mid-gloss-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-5-x-4-125-sheet-labels-white-premium-high-gloss-9.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-25-x-10-75-sheet-labels-white-premium-high-gloss-485.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-5625-x-1-75-sheet-labels-white-matte-litho-440.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-75-x-2-75-sheet-labels-white-premium-high-gloss-822.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S815MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/10-6-x-1-18-sheet-labels-clear-matte-82.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-52-x-4-52-sheet-labels-clear-matte-155.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-5-sheet-labels-clear-matte-193.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-59375-x-1-3-sheet-labels-white-mid-gloss-76.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/5-5-x-4-125-sheet-labels-white-premium-high-gloss-9.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S194GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-25-x-10-75-sheet-labels-white-premium-high-gloss-485.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S440ML already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:07 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 18:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S780MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:07 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4013A-PINK-XL>: HTTP status code is not handled or not allowed 2025-11-08 18:04:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17576 pages (at 14 pages/min), scraped 8769 items (at 6 items/min) 2025-11-08 18:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:11 [scrapy.downloadermiddlewares.retry] (PID: 109) ERROR: Gave up retrying (failed 6 times): 403 Forbidden 2025-11-08 18:04:11 [scrapy.spidermiddlewares.httperror] (PID: 109) INFO: Ignoring response <403 https://www.smithcorona.com/6-x-9-thermal-transfer-labels-3-core-purple.html>: HTTP status code is not handled or not allowed 2025-11-08 18:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-6875-x-2-sheet-labels-clear-matte-640.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S82CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT6090AP-POLY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S840CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-52-x-4-52-sheet-labels-clear-matte-155.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-625-x-1-sheet-labels-crystal-clear-15.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-875-x-1-0625-sheet-labels-clear-matte-868.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=RTT4080AP-GRAPE already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76MG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-4-875-sheet-labels-crystal-clear-59.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71GIN already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S9GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S525CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485GLA already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S640CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17602 pages (at 26 pages/min), scraped 8781 items (at 12 items/min) 2025-11-08 18:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S15CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S868CL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S410CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S485CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S823CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S832CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S866CCL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S206SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S500SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S695SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874SR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17641 pages (at 39 pages/min), scraped 8800 items (at 19 items/min) 2025-11-08 18:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S184GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S202GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S199GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S829GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S877GR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S11TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S565TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S610TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S690TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S785TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S817TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S885TU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S42WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17680 pages (at 39 pages/min), scraped 8819 items (at 19 items/min) 2025-11-08 18:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S175WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S190WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S285WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S680WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S816WPL already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S26VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S185VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S195VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745VD already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S28PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S76PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17720 pages (at 40 pages/min), scraped 8841 items (at 22 items/min) 2025-11-08 18:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S460PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S735PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S860PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S869PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874PP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S86PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S129PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S545PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876PU already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S41PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S106PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S35PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17761 pages (at 41 pages/min), scraped 8861 items (at 20 items/min) 2025-11-08 18:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S133PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S360PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S863PG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S51PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S138PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S605PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S675PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870PY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S181PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17798 pages (at 37 pages/min), scraped 8879 items (at 18 items/min) 2025-11-08 18:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S85PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S145PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S390PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S295PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S853PT already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S59BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S78BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S81BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S84BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S71BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S180BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S864BK already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S55FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S97FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17842 pages (at 44 pages/min), scraped 8900 items (at 21 items/min) 2025-11-08 18:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S108FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S201FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S207FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S340FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S665FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S883FR already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S46FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S73FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S92FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S220FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S137FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S280FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S290FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S365FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S420FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17879 pages (at 37 pages/min), scraped 8919 items (at 19 items/min) 2025-11-08 18:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S510FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S29FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-75-x-3-sheet-labels-fluorescent-yellow-310.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-fluorescent-yellow-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-yellow-355.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-8584-x-4-8037-sheet-labels-fluorescent-yellow-827.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-sheet-labels-fluorescent-yellow-876.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-2-75-sheet-labels-fluorescent-orange-170.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-6-x-1-77-sheet-labels-fluorescent-orange-430.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17908 pages (at 29 pages/min), scraped 8935 items (at 16 items/min) 2025-11-08 18:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-fluorescent-orange-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-orange-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-75-x-2-75-sheet-labels-fluorescent-orange-822.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-fluorescent-orange-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-5-375-sheet-labels-fluorescent-orange-872.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-fluorescent-orange-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-blue-187.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-75-x-3-sheet-labels-fluorescent-yellow-310.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-fluorescent-yellow-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-yellow-355.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-8584-x-4-8037-sheet-labels-fluorescent-yellow-827.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-sheet-labels-fluorescent-yellow-876.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-2-75-sheet-labels-fluorescent-orange-170.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-6-x-1-77-sheet-labels-fluorescent-orange-430.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-fluorescent-orange-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-orange-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-75-x-2-75-sheet-labels-fluorescent-orange-822.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-fluorescent-orange-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-5-375-sheet-labels-fluorescent-orange-872.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-fluorescent-orange-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-blue-187.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-75-x-3-sheet-labels-fluorescent-yellow-310.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17908 pages (at 0 pages/min), scraped 8935 items (at 0 items/min) 2025-11-08 18:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-fluorescent-yellow-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-yellow-355.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-8584-x-4-8037-sheet-labels-fluorescent-yellow-827.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-sheet-labels-fluorescent-yellow-876.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-2-75-sheet-labels-fluorescent-orange-170.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-6-x-1-77-sheet-labels-fluorescent-orange-430.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-fluorescent-orange-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-orange-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-75-x-2-75-sheet-labels-fluorescent-orange-822.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-fluorescent-orange-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-5-375-sheet-labels-fluorescent-orange-872.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-fluorescent-orange-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-blue-187.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-75-x-3-sheet-labels-fluorescent-yellow-310.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-fluorescent-yellow-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-yellow-355.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S770FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-8584-x-4-8037-sheet-labels-fluorescent-yellow-827.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S826FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/3-x-5-sheet-labels-fluorescent-yellow-876.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-25-x-2-75-sheet-labels-fluorescent-orange-170.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-6-x-1-77-sheet-labels-fluorescent-orange-430.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S891FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-fluorescent-orange-585.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-orange-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-75-x-2-75-sheet-labels-fluorescent-orange-822.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17908 pages (at 0 pages/min), scraped 8935 items (at 0 items/min) 2025-11-08 18:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-fluorescent-orange-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-375-x-5-375-sheet-labels-fluorescent-orange-872.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-x-3-25-sheet-labels-fluorescent-orange-878.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S874FP already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-blue-187.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S193FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/4-75-x-3-sheet-labels-fluorescent-yellow-310.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-5-x-1-5-sheet-labels-fluorescent-yellow-330.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S730FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/8-5-x-11-sheet-labels-fluorescent-yellow-355.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S827FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S876FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S867FG already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S170FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S430FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S16FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-x-1-sheet-labels-fluorescent-orange-630.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S822FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/1-125-x-2-6875-sheet-labels-fluorescent-orange-870.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S187FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S310FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S355FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17930 pages (at 22 pages/min), scraped 8942 items (at 7 items/min) 2025-11-08 18:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S530FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S595FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S630FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S870FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S872FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S710FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S745FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S330FY already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S878FO already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S45GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/2-x-2-sheet-labels-gold-foil-77.html already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S585FB already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S89GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S130GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S99GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S214GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S505GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S535GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S615GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S700GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S720GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:08 [scrapy.extensions.logstats] (PID: 109) INFO: Crawled 17963 pages (at 33 pages/min), scraped 8960 items (at 18 items/min) 2025-11-08 18:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S47SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S54SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S87SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S77GF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S109SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S135SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S155SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S320SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 109) WARNING: Request https://www.smithcorona.com/smithcorona_productdatarepository/ProductPage/Index?sku=S421SF already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS. 2025-11-08 18:17:58 [scrapy.core.engine] (PID: 109) INFO: Closing spider (finished) 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.) 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) ERROR: [Spidermon] ====================================================================== FAIL: Error Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/ERROR' to be '<=' to '7.0'. Current value: '17' 2025-11-08 18:17:58 [smith_corona] (PID: 109) ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '10013' 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] 11 monitors in 0.005s 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] FAILED (failures=2, skipped=1) 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] 0 actions in 0.000s 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] 0 actions in 0.000s 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2025-11-08 18:17:58 [spidermon.contrib.actions.slack] (PID: 109) WARNING: bot cannot finder user in slack org member list - default icon url used 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... OK 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] ---------------------------------------------------------------------- 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] 1 action in 0.413s 2025-11-08 18:17:58 [smith_corona] (PID: 109) INFO: [Spidermon] OK 2025-11-08 18:17:59 [scrapy.extensions.feedexport] (PID: 109) INFO: Stored bq feed (984 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:9 2025-11-08 18:17:59 [scrapy.statscollectors] (PID: 109) INFO: Dumping Scrapy stats: {'HeadersSpooferDownloaderMiddleware/spoofed': 19005, 'NotFoundHandlerSpiderMiddleware/HttpError': 17, 'big_query/url': 9002, 'downloader/exception_count': 4, 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 4, 'downloader/request_bytes': 15813290, 'downloader/request_count': 19005, 'downloader/request_method_count/GET': 19005, 'downloader/response_bytes': 995365201, 'downloader/response_count': 19001, 'downloader/response_status_count/200': 17979, 'downloader/response_status_count/301': 1, 'downloader/response_status_count/403': 1021, 'dupefilter/filtered': 1, 'elapsed_time_seconds': 28970.104605, 'feedexport/success_count/BigQueryFeedStorage': 9, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 11, 8, 18, 17, 58, 319632, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 7829640619, 'httpcompression/response_count': 17979, 'httperror/response_ignored_count': 17, 'httperror/response_ignored_status_count/403': 17, 'item_scraped_count': 8984, 'items_per_minute': None, 'log_count/ERROR': 19, 'log_count/INFO': 550, 'log_count/WARNING': 10014, 'memusage/max': 248918016, 'memusage/startup': 126083072, 'poet/injector/catalog_extraction.pages.smith_corona.SmithCoronaSingleProductPageObject': 8994, 'proxy_manager/ignored/proxy_defined': 1009, 'proxy_manager/processed': 17996, 'request_depth_max': 1, 'response_received_count': 17996, 'responses_per_minute': None, 'retry/count': 1008, 'retry/max_reached': 17, 'retry/reason_count/403 Forbidden': 1004, 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 4, 'scheduler/dequeued': 19005, 'scheduler/dequeued/memory': 19005, 'scheduler/enqueued': 19005, 'scheduler/enqueued/memory': 19005, 'spidermon/validation/fields': 188664, 'spidermon/validation/items': 8984, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'spidermon_field_coverage/dict/brand': 1.0, 'spidermon_field_coverage/dict/categories': 1.0, 'spidermon_field_coverage/dict/countryOfOrigin': 1.0, 'spidermon_field_coverage/dict/description': 1.0, 'spidermon_field_coverage/dict/imageUrl': 1.0, 'spidermon_field_coverage/dict/inStock': 1.0, 'spidermon_field_coverage/dict/isFreeShipping': 1.0, 'spidermon_field_coverage/dict/leadTime': 1.0, 'spidermon_field_coverage/dict/manufacturer': 1.0, 'spidermon_field_coverage/dict/manufacturerSku': 1.0, 'spidermon_field_coverage/dict/name': 1.0, 'spidermon_field_coverage/dict/packagingIncrement': 1.0, 'spidermon_field_coverage/dict/prices': 1.0, 'spidermon_field_coverage/dict/productStatus': 1.0, 'spidermon_field_coverage/dict/relatedSkus': 1.0, 'spidermon_field_coverage/dict/specifications': 1.0, 'spidermon_field_coverage/dict/supplier': 1.0, 'spidermon_field_coverage/dict/supplierSku': 1.0, 'spidermon_field_coverage/dict/uom': 1.0, 'spidermon_field_coverage/dict/url': 1.0, 'spidermon_field_coverage/dict/weight': 1.0, 'spidermon_item_scraped_count': 8984, 'spidermon_item_scraped_count/dict': 8984, 'spidermon_item_scraped_count/dict/brand': 8984, 'spidermon_item_scraped_count/dict/categories': 8984, 'spidermon_item_scraped_count/dict/countryOfOrigin': 8984, 'spidermon_item_scraped_count/dict/description': 8984, 'spidermon_item_scraped_count/dict/imageUrl': 8984, 'spidermon_item_scraped_count/dict/inStock': 8984, 'spidermon_item_scraped_count/dict/isFreeShipping': 8984, 'spidermon_item_scraped_count/dict/leadTime': 8984, 'spidermon_item_scraped_count/dict/manufacturer': 8984, 'spidermon_item_scraped_count/dict/manufacturerSku': 8984, 'spidermon_item_scraped_count/dict/name': 8984, 'spidermon_item_scraped_count/dict/packagingIncrement': 8984, 'spidermon_item_scraped_count/dict/prices': 8984, 'spidermon_item_scraped_count/dict/productStatus': 8984, 'spidermon_item_scraped_count/dict/relatedSkus': 8984, 'spidermon_item_scraped_count/dict/specifications': 8984, 'spidermon_item_scraped_count/dict/supplier': 8984, 'spidermon_item_scraped_count/dict/supplierSku': 8984, 'spidermon_item_scraped_count/dict/uom': 8984, 'spidermon_item_scraped_count/dict/url': 8984, 'spidermon_item_scraped_count/dict/weight': 8984, 'start_requests/big_query': 9002, 'start_time': datetime.datetime(2025, 11, 8, 10, 15, 8, 215027, tzinfo=datetime.timezone.utc)} 2025-11-08 18:17:59 [scrapy.core.engine] (PID: 109) INFO: Spider closed (finished)