2024-09-27 16:24:12 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: catalog_discovery) 2024-09-27 16:24:12 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.9 (main, Aug 13 2024, 01:19:58) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-6.4.10-dirty-x86_64-with-glibc2.36 2024-09-27 16:24:13 [scrapy.addons] INFO: Enabled addons: [] 2024-09-27 16:24:13 [scrapy.extensions.telnet] INFO: Telnet Password: ecac08cd657a1a77 2024-09-27 16:24:13 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.feedexport.FeedExporter', 'scrapy.extensions.logstats.LogStats', 'spidermon.contrib.scrapy.extensions.Spidermon'] 2024-09-27 16:24:13 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'catalog_discovery', 'CONCURRENT_ITEMS': 1000, 'CONCURRENT_REQUESTS': 32, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_discovery/home_depot/eb2a47ac7cec11efa9cf4200a9fe0102.log', 'LOG_LEVEL': 'INFO', 'NEWSPIDER_MODULE': 'catalog_discovery.spiders', 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter', 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7', 'RETRY_TIMES': 5, 'SPIDER_MODULES': ['catalog_discovery.spiders'], 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor', 'USER_AGENT': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:125.0) ' 'Gecko/20100101 Firefox/125.0'} 2024-09-27 16:24:13 [scrapy_poet.injection] INFO: Loading providers: [, , , , , , ] 2024-09-27 16:24:13 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy_poet.InjectionMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy_poet.DownloaderStatsMiddleware'] 2024-09-27 16:24:13 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy_poet.RetryMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2024-09-27 16:24:13 [scrapy.middleware] INFO: Enabled item pipelines: ['scraping_utils.pipelines.DuplicatesFilterPipeline', 'scraping_utils.pipelines.AttachSupplierPipeline', 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline'] 2024-09-27 16:24:13 [scrapy.core.engine] INFO: Spider opened 2024-09-27 16:24:13 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2024-09-27 16:24:13 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023 2024-09-27 16:24:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Weller-SAC-M1-Solder-Wire-Ø-1-2-mm-500g-T0051386199/319748734', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:1 2024-09-27 16:24:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:2 2024-09-27 16:24:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:3 2024-09-27 16:24:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:4 2024-09-27 16:24:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Deco-Products-Take-Home-Sample-COLORS-Glue-Down-Floor-Wall-Old-Navy-Ocean-Aged-Wood-6-in-x-6-in-ÿMulti-TonalÿLuxury-Vinyl-Plank-SDVF10/304276400', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:5 2024-09-27 16:24:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/71-3-in-H-×-63-in-L-4-Panel-Iron-Black-Room-Divider-Folding-Privacy-Screen-Wall-Partition-TOUTD712/326297692', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:6 2024-09-27 16:24:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:7 2024-09-27 16:24:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Armstrong-Take-Home-Sample-ÿBeige-Slate-Peel-and-Stick-Vinyl-Tile-Flooring-5-in-x-7-in-AR-302976/317157876', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:8 2024-09-27 16:24:34 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Weller-SAC-L0-Solder-Wire-Ø-1-0mm-500g-T0051386899/319999970', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:34 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Weller-SAC-M1-Solder-Wire-Ø-1-0-mm-100g-T0051402499/319748931', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:9 2024-09-27 16:24:36 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Nostalgia-Café-Ice-12-Cup-Black-Iced-Coffee-and-Tea-Brewing-System-with-Plastic-Pitcher-NCIT3PLSBK/324567885', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:10 2024-09-27 16:24:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:11 2024-09-27 16:24:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:12 2024-09-27 16:24:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:13 2024-09-27 16:24:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:14 2024-09-27 16:24:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:15 2024-09-27 16:24:46 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Deco-Products-Take-Home-Sample-COLORS-Glue-Down-Floor-and-Wall-DIY-Old-Desert-Aged-Wood-6-in-x-6-in-ÿMulti-TonalÿLuxury-Vinyl-Plank-SDVF8/309893945', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:16 2024-09-27 16:24:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:17 2024-09-27 16:24:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Non-Woven-Fiber-Mulch-Tree-Ring-Kit-Día-9-84-in-12-Pack-NWMTR25D12P/321295318', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/71-3-in-H-×-63-in-L-4-Panel-Iron-Brown-Room-Divider-Folding-Privacy-Screen-Wall-Partition-TOUTD713/326297832', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:18 2024-09-27 16:24:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Deco-Products-Take-Home-Sample-COLORS-Glue-Down-Floor-Wall-DIY-Old-Blue-Sea-Aged-Wood-6-in-x-6-in-ÿMulti-TonalÿLuxury-Vinyl-Plank-SDVF2/304276374', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:24:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:19 2024-09-27 16:24:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:20 2024-09-27 16:24:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:21 2024-09-27 16:24:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:22 2024-09-27 16:24:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:23 2024-09-27 16:24:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/DUPRAY-Voilà-3-in-1-Steamer-for-Clothes-Handheld-Garment-Steamer-Portable-Travel-Steam-for-Clothing-GAR030WNA/317981110', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:25:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:24 2024-09-27 16:25:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/85-6-in-×-72-in-PVC-Arched-Arbor-PT-10-00003-W/323376685', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:25:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:25 2024-09-27 16:25:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/5-in-W-×-5-in-H-Black-Plastic-Garden-Landscape-Edging-Border-Coil-60-ft-with-18-Pieces-Stakes-TOUTD733/326308878', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:25:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:26 2024-09-27 16:25:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:27 2024-09-27 16:25:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:28 2024-09-27 16:25:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:29 2024-09-27 16:25:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:30 2024-09-27 16:25:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:31 2024-09-27 16:25:13 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 67 pages/min), scraped 80437 items (at 80437 items/min) 2024-09-27 16:25:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:32 2024-09-27 16:25:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Armstrong-Take-Home-Sample-ÿBeach-Sand-Peel-and-Stick-Vinyl-Tile-Flooring-5-in-x-7-in-AR-691648/317157885', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:25:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:33 2024-09-27 16:25:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:34 2024-09-27 16:25:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:35 2024-09-27 16:25:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:36 2024-09-27 16:25:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:37 2024-09-27 16:25:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:38 2024-09-27 16:25:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:39 2024-09-27 16:25:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:40 2024-09-27 16:25:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:41 2024-09-27 16:25:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:42 2024-09-27 16:25:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:43 2024-09-27 16:25:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:44 2024-09-27 16:25:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:45 2024-09-27 16:25:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:46 2024-09-27 16:25:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:47 2024-09-27 16:25:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:48 2024-09-27 16:25:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:49 2024-09-27 16:25:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:50 2024-09-27 16:25:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:51 2024-09-27 16:25:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:52 2024-09-27 16:25:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:53 2024-09-27 16:25:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:54 2024-09-27 16:25:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:55 2024-09-27 16:25:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:56 2024-09-27 16:25:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:57 2024-09-27 16:25:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:58 2024-09-27 16:25:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:59 2024-09-27 16:26:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:60 2024-09-27 16:26:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:61 2024-09-27 16:26:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:62 2024-09-27 16:26:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:63 2024-09-27 16:26:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:64 2024-09-27 16:26:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:65 2024-09-27 16:26:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:66 2024-09-27 16:26:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:67 2024-09-27 16:26:13 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 0 pages/min), scraped 169222 items (at 88785 items/min) 2024-09-27 16:26:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:68 2024-09-27 16:26:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:69 2024-09-27 16:26:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:70 2024-09-27 16:26:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:71 2024-09-27 16:26:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:72 2024-09-27 16:26:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:73 2024-09-27 16:26:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:74 2024-09-27 16:26:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:75 2024-09-27 16:26:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:76 2024-09-27 16:26:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:77 2024-09-27 16:26:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:78 2024-09-27 16:26:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:79 2024-09-27 16:26:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:80 2024-09-27 16:26:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:81 2024-09-27 16:26:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:82 2024-09-27 16:26:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:83 2024-09-27 16:26:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:84 2024-09-27 16:26:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:85 2024-09-27 16:26:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:86 2024-09-27 16:26:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:87 2024-09-27 16:26:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:88 2024-09-27 16:26:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:89 2024-09-27 16:26:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:90 2024-09-27 16:26:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:91 2024-09-27 16:26:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:92 2024-09-27 16:26:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:93 2024-09-27 16:26:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:94 2024-09-27 16:27:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:95 2024-09-27 16:27:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:96 2024-09-27 16:27:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:97 2024-09-27 16:27:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:98 2024-09-27 16:27:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:99 2024-09-27 16:27:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:100 2024-09-27 16:27:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:101 2024-09-27 16:27:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:102 2024-09-27 16:27:13 [scrapy.extensions.logstats] INFO: Crawled 67 pages (at 0 pages/min), scraped 257682 items (at 88460 items/min) 2024-09-27 16:27:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:103 2024-09-27 16:27:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:104 2024-09-27 16:27:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:105 2024-09-27 16:27:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:106 2024-09-27 16:27:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:107 2024-09-27 16:27:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:108 2024-09-27 16:27:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:109 2024-09-27 16:27:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:110 2024-09-27 16:27:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:111 2024-09-27 16:27:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:112 2024-09-27 16:27:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:113 2024-09-27 16:27:37 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Light-Grey-Leafy-Vines-Non-Pasted-Non-Woven-Paper-Wallpaper-4143-34017/327154439', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:114 2024-09-27 16:27:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:115 2024-09-27 16:27:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Navy-Armchair-With-Solid-Wood-Legs-Set-of-2-CHM0584-NAVY-S2/322865694', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:116 2024-09-27 16:27:43 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-15-7-in-x24-4-in-Tongue-Groove-Decorative-PVC-Bathroom-and-Shower-Wall-Tiles-in-Rustic-Concrete-Light-Gray-8-Piece-706010/313348296', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:117 2024-09-27 16:27:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:118 2024-09-27 16:27:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:119 2024-09-27 16:27:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:120 2024-09-27 16:27:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VEIKOUS-12-ft-W-×-10-ft-D-Cedar-Wood-Patio-Pergola-Shade-Structure-for-Outdoor-Brown-PG0202-05-3/328866347', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:121 2024-09-27 16:27:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Brown-Traditional-Square-Vegan-Leather-Armchair-with-Nailhead-Trims-and-Button-tufted-Back-CHYZ0520-BROWN/323233538', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Outdoor-Throw-Pillow-Covers-Dark-Grey-Cozy-Soft-Velvet-Square-Decorative-Pillow-Cases-for-Farmhouse-Home-Décor-2-Pack-B07Y7X5MDK/326643504', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:27:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:122 2024-09-27 16:27:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:123 2024-09-27 16:27:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:124 2024-09-27 16:27:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:125 2024-09-27 16:27:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:126 2024-09-27 16:28:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:127 2024-09-27 16:28:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:128 2024-09-27 16:28:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:129 2024-09-27 16:28:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:130 2024-09-27 16:28:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:131 2024-09-27 16:28:15 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 41 pages/min), scraped 328982 items (at 71300 items/min) 2024-09-27 16:28:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:132 2024-09-27 16:28:22 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-3-Piece-Green-Living-Room-Set-with-Button-Tufted-SF0422-M3288-S2-GREE/321759262', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:133 2024-09-27 16:28:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:134 2024-09-27 16:28:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:135 2024-09-27 16:28:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:136 2024-09-27 16:28:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:137 2024-09-27 16:28:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:138 2024-09-27 16:28:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/DIP-Design-Is-Personal-Weed-Cañejo-Vinyl-Peelable-Roll-Covers-30-75-sq-ft-DC10406/312604973', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:139 2024-09-27 16:28:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:140 2024-09-27 16:28:34 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Yellow-Drömma-Coral-Songbirds-and-Sunflowers-Paper-Non-Pasted-Non-Woven-Matte-Wallpaper-4111-63008/322489136', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:141 2024-09-27 16:28:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:142 2024-09-27 16:28:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:143 2024-09-27 16:28:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/9-ft-×-9-ft-Square-Cantilever-Umbrella-For-Your-Outdoor-Space-240-g-Solution-Dyed-Fabric-Aluminum-Frame-in-Gray-J-99GY/329056123', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:144 2024-09-27 16:28:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:145 2024-09-27 16:28:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:146 2024-09-27 16:28:46 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Storied-Home-2-Piece-Wood-Framed-Hand-Painted-Fruit-In-Bowls-Wall-Décor-Art-Print-26-in-x-23-in-DF7903SET/327211622', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:147 2024-09-27 16:28:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:148 2024-09-27 16:28:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Black-Square-Armchair-with-Nailhead-Trims-CHYZ0521-BLACK/323234830', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:149 2024-09-27 16:28:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Subway-12-in-×-4-in-×-0-12-in-Black-Peel-and-Stick-backsplash-Stone-Composite-Wall-Tile-10-sq-ft-Case-100300-BLK-30/328031122', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Green-Leafy-Vines-Wallpaper-Sample-4143-34020SAM/327154364', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Midnight-Beasts-Blush-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118565/323601316', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:150 2024-09-27 16:28:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Metal-Gold-Indoor-Outdoor-Sun-Wall-Décor-TG02UUJ/325705985', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/HDX-13-Gal-Â-FLEXÂ-White-Drawstring-Kitchen-Trash-Bags-55-Count-HDX959537/203472837', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Notre-Dame-Façade-by-Marmont-Hill-Framed-Architecture-Art-Print-30-in-x-45-in-LITI5002BFPFL45/324657669', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:54 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NuWallpaper-Grey-Brick-Façade-Gray-Wallpaper-Sample-NU2236SAM/301900858', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:151 2024-09-27 16:28:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:152 2024-09-27 16:28:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:153 2024-09-27 16:28:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Green-Drömma-Sage-Songbirds-and-Sunflowers-Paper-Non-Pasted-Non-Woven-Matte-Wallpaper-4111-63009/322489128', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:28:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:154 2024-09-27 16:29:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:155 2024-09-27 16:29:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Mustard-3-Piece-Living-Room-Set-with-Button-Tufted-SF0422-MA3288-S2-MUS/321768095', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:156 2024-09-27 16:29:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:157 2024-09-27 16:29:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Forest-Chinoiserie-Antique-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118558/323619750', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:158 2024-09-27 16:29:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Pink-3-Piece-Living-Room-Set-with-Button-Tufted-SF0422-MA3288-S2-PIN/321768143', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:159 2024-09-27 16:29:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:160 2024-09-27 16:29:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Grey-Leafy-Vines-Non-Pasted-Non-Woven-Paper-Wallpaper-4143-34016/327154438', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:161 2024-09-27 16:29:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 405573 items (at 76591 items/min) 2024-09-27 16:29:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:162 2024-09-27 16:29:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:163 2024-09-27 16:29:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:164 2024-09-27 16:29:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:165 2024-09-27 16:29:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:166 2024-09-27 16:29:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:167 2024-09-27 16:29:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:168 2024-09-27 16:29:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:169 2024-09-27 16:29:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:170 2024-09-27 16:29:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mind-Reader-Decorative-Tall-Quilt-Blanket-Ladder-Vintage-Living-Room-Décor-Premium-Wood-1-5-L-x-20-W-x-53-75-H-Brown-WDECLAD-BRN/323115560', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:171 2024-09-27 16:29:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:172 2024-09-27 16:29:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:173 2024-09-27 16:29:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Navy-Traditional-Square-Vegan-Leather-Armchair-with-Nailhead-Trims-and-Button-tufted-Back-CHYZ0520-NAVY/323233429', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:29:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:174 2024-09-27 16:29:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:175 2024-09-27 16:29:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:176 2024-09-27 16:29:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:177 2024-09-27 16:29:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:178 2024-09-27 16:30:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:179 2024-09-27 16:30:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:180 2024-09-27 16:30:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 452816 items (at 47243 items/min) 2024-09-27 16:30:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:181 2024-09-27 16:30:15 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Harbour-Dogs-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118560/323601251', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:30:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:182 2024-09-27 16:30:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:183 2024-09-27 16:30:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:184 2024-09-27 16:31:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:185 2024-09-27 16:31:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-18-5-in-x-24-3-in-Artnouvo-Decorative-3D-PVC-Backsplash-Panels-in-Smoked-Pewter-30-Pieces-705215/321722076', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:31:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:186 2024-09-27 16:31:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Ivory-3-Piece-Living-Room-Set-with-Button-Tufted-SF0422-MA3288-S2-IVO/321768105', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:31:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:187 2024-09-27 16:31:21 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 468799 items (at 15983 items/min) 2024-09-27 16:32:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:188 2024-09-27 16:32:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 471487 items (at 2688 items/min) 2024-09-27 16:32:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NOTRE-DAME-DESIGN-Beccy-Pill-40-in-H-x-26-in-W-Modern-Rectangular-Brass-Framed-Décor-Mirror-NDD22M024/323207460', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:32:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:189 2024-09-27 16:32:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NuWallpaper-Grey-Brick-Façade-Vinyl-Peel-and-Stick-Wallpaper-Roll-Covers-30-75-sq-ft-NU2236HD2/302245130', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:32:36 [urllib3.connectionpool] WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)')': /token 2024-09-27 16:33:20 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 475048 items (at 3561 items/min) 2024-09-27 16:34:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:190 2024-09-27 16:34:19 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 476049 items (at 1001 items/min) 2024-09-27 16:34:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:191 2024-09-27 16:34:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Mustard-Armchair-With-Solid-Wood-Legs-CHM0584-MUSTARD/322864220', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:35:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:192 2024-09-27 16:35:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:193 2024-09-27 16:35:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:194 2024-09-27 16:35:09 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/9-ft-×-9-ft-Outdoor-Square-Cantilever-LED-Patio-Umbrella-240-g-Solution-Dyed-Fabric-Aluminum-Frame-in-Taupe-J-99TP-LED/329056208', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:35:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:195 2024-09-27 16:35:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 489466 items (at 13417 items/min) 2024-09-27 16:35:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:196 2024-09-27 16:35:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:197 2024-09-27 16:35:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:198 2024-09-27 16:35:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:199 2024-09-27 16:35:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:200 2024-09-27 16:35:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NOTRE-DAME-DESIGN-Jagger-30-in-H-x-30-in-W-Modern-Round-Gold-Framed-Décor-Mirror-NDD22M026/323207463', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:35:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Etched-Woodland-Crème-Multi-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118553/323601265', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:36:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:201 2024-09-27 16:36:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:202 2024-09-27 16:36:15 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 506096 items (at 16630 items/min) 2024-09-27 16:36:18 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Black-3-Piece-Living-Room-Set-with-Button-Tufted-SF0422-MA3288-S2-BLA/321768099', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:36:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:203 2024-09-27 16:36:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:204 2024-09-27 16:36:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:205 2024-09-27 16:36:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:206 2024-09-27 16:37:16 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 515622 items (at 9526 items/min) 2024-09-27 16:38:14 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 517162 items (at 1540 items/min) 2024-09-27 16:39:16 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 517372 items (at 210 items/min) 2024-09-27 16:40:07 [urllib3.connectionpool] WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)')': /token 2024-09-27 16:40:21 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 517519 items (at 147 items/min) 2024-09-27 16:40:29 [urllib3.connectionpool] WARNING: Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)')': /token 2024-09-27 16:40:48 [urllib3.connectionpool] WARNING: Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)')': /token 2024-09-27 16:41:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:207 2024-09-27 16:41:14 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 517736 items (at 217 items/min) 2024-09-27 16:41:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Navy-Armchair-with-Nailhead-Trims-Set-of-2-CHYZ0521-NAVY-S2/323235011', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:41:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Mustard-Armchair-With-Solid-Wood-Legs-Set-of-2-CHM0584-MUSTARD-S2/322865701', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:41:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Botanical-Bee-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118544/323601295', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:41:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:208 2024-09-27 16:42:16 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 521289 items (at 3553 items/min) 2024-09-27 16:43:22 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 521422 items (at 133 items/min) 2024-09-27 16:44:14 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 521506 items (at 84 items/min) 2024-09-27 16:44:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:209 2024-09-27 16:45:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Charcoal-Armchair-With-Solid-Wood-Legs-Set-of-2-CHM0584-CHARCOAL-S2/322865690', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:45:20 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 525012 items (at 3506 items/min) 2024-09-27 16:45:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:210 2024-09-27 16:45:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:211 2024-09-27 16:45:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Hampton-Bay-10-ft-Commercial-Aluminum-Cantilever-Square-Offset-Patio-Umbrella-in-Cafe-Tan-with-Base-Included-YJAF-819C-Café/317256813', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:46:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:212 2024-09-27 16:46:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Grey-Drömma-Light-Grey-Songbirds-and-Sunflowers-Wallpaper-Sample-4111-63011SAM/322509989', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:46:15 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 532504 items (at 7492 items/min) 2024-09-27 16:46:30 [urllib3.connectionpool] WARNING: Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:2427)')': /token 2024-09-27 16:46:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:213 2024-09-27 16:46:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Storied-Home-Metal-Distressed-Antique-Finish-Floral-Bouquets-Wall-Décor-DA9285/320459466', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:46:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:214 2024-09-27 16:46:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/AndMakers-Liverpool-46-in-W-×-36-in-H-Rectangle-Wood-Frame-Black-Dresser-Mirror-PF-G01600-M/327132262', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:46:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:215 2024-09-27 16:46:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:216 2024-09-27 16:46:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:217 2024-09-27 16:46:55 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Fields-Edge-Floral-Antique-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118569/323619753', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:47:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:218 2024-09-27 16:47:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:219 2024-09-27 16:47:16 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 547708 items (at 15204 items/min) 2024-09-27 16:48:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:220 2024-09-27 16:48:17 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 550174 items (at 2466 items/min) 2024-09-27 16:49:18 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 550414 items (at 240 items/min) 2024-09-27 16:50:15 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 550486 items (at 72 items/min) 2024-09-27 16:51:14 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 551434 items (at 948 items/min) 2024-09-27 16:52:18 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 551536 items (at 102 items/min) 2024-09-27 16:53:17 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 551686 items (at 150 items/min) 2024-09-27 16:54:28 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 551800 items (at 114 items/min) 2024-09-27 16:55:19 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 551860 items (at 60 items/min) 2024-09-27 16:55:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:221 2024-09-27 16:55:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:222 2024-09-27 16:55:24 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Grey-Armchair-With-Solid-Wood-Legs-Set-of-2-CHM0584-GREY-S2/322865696', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:223 2024-09-27 16:55:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:224 2024-09-27 16:55:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:225 2024-09-27 16:55:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:226 2024-09-27 16:55:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Yellow-Drömma-Butter-Songbirds-and-Sunflowers-Paper-Non-Pasted-Non-Woven-Matte-Wallpaper-4111-63010/322489143', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:227 2024-09-27 16:55:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:228 2024-09-27 16:55:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:229 2024-09-27 16:55:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:230 2024-09-27 16:55:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:231 2024-09-27 16:55:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:232 2024-09-27 16:55:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:233 2024-09-27 16:55:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:234 2024-09-27 16:55:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Grey-Drömma-Songbirds-and-Sunflowers-Paper-Non-Pasted-Non-Woven-Matte-Wallpaper-4111-63011/322489147', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:235 2024-09-27 16:55:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:236 2024-09-27 16:55:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:237 2024-09-27 16:55:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:238 2024-09-27 16:55:46 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Ivory-Armchair-With-Solid-Wood-Legs-Set-of-2-CHM0584-IVORY-S2/322865704', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:239 2024-09-27 16:55:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:240 2024-09-27 16:55:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/White-Wooden-Shoes-Storage-Cabinet-with-Adjustable-Shelves-and-2-Drawers-31-5-in-W-×-39-4-in-H-LBB-KF260056-01/323767895', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:241 2024-09-27 16:55:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:242 2024-09-27 16:55:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:243 2024-09-27 16:55:54 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/52-in-W-×-54-in-D-×-70-9-in-H-Iron-Hammock-Stand-in-White-SYXY52713740/324052933', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:244 2024-09-27 16:55:54 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Navy-Armchair-with-Solid-Wood-Legs-CHM0584-NAVY/322864207', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:245 2024-09-27 16:55:56 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Sketchy-Dogs-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118559/323601250', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:56 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-15-7-in-x-24-4-in-Tongue-Groove-Decorative-PVC-Bathroom-and-Shower-Wall-Tiles-in-Carrara-Marble-White-8-Piece-706007/313348307', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:55:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:246 2024-09-27 16:55:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:247 2024-09-27 16:55:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/York-Wallcoverings-Grey-Café-Society-Paper-Unpasted-Matte-Wallpaper-27-in-x-27-ft-CI2363/325573413', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:248 2024-09-27 16:56:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:249 2024-09-27 16:56:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:250 2024-09-27 16:56:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:251 2024-09-27 16:56:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:252 2024-09-27 16:56:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:253 2024-09-27 16:56:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:254 2024-09-27 16:56:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:255 2024-09-27 16:56:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:256 2024-09-27 16:56:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-18-5-in-x-24-3-in-Empire-Decorative-3D-PVC-Backsplash-Panels-in-Bronze-30-Pieces-704550/321723158', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/10-ft-×-20-ft-Outdoor-Adjustable-Pop-Up-Canopy-Tent-with-Wheeled-Carry-Bag-White-DYr3y70001/328792451', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:257 2024-09-27 16:56:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 644596 items (at 92736 items/min) 2024-09-27 16:56:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:258 2024-09-27 16:56:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:259 2024-09-27 16:56:16 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Boho-Bloom-Crème-Matte-Non-Woven-Removable-Paste-the-Wall-Wallpaper-118561/323601324', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:260 2024-09-27 16:56:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Teal-3-Piece-Living-Room-Set-with-Button-Tufted-SF0422-MA3288-S2-TEA/321768126', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:261 2024-09-27 16:56:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:262 2024-09-27 16:56:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:263 2024-09-27 16:56:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:264 2024-09-27 16:56:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:265 2024-09-27 16:56:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:266 2024-09-27 16:56:25 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Camel-Traditional-Square-Vegan-Leather-Armchair-with-Nailhead-Trims-and-Button-tufted-Back-Set-of-2-CHYZ0520-CAMEL-S2/323233476', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-24-3-in-x-18-5-in-Artnouvo-Decorative-3D-PVC-Backsplash-Panels-in-Smoked-Pewter-12-Pieces-706687/316856388', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-15-7-in-x-24-4-in-Tongue-Groove-Decorative-PVC-Bathroom-and-Shower-Wall-Tiles-in-Urban-Cement-Light-Gray-8-Piece-706016/313347771', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:267 2024-09-27 16:56:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:268 2024-09-27 16:56:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:269 2024-09-27 16:56:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:270 2024-09-27 16:56:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:271 2024-09-27 16:56:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:272 2024-09-27 16:56:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:273 2024-09-27 16:56:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:274 2024-09-27 16:56:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:275 2024-09-27 16:56:39 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-18-5-x-24-3-Empire-Decorative-3D-PVC-Backsplash-Panels-in-Smoked-Pewter-12-Pieces-706689/316857198', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:276 2024-09-27 16:56:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/AndMakers-Franklin-39-in-W-×-35-in-H-Rectangle-Wood-Frame-Brown-Dresser-Mirror-PF-G01900-M/327132263', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:277 2024-09-27 16:56:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Navy-Traditional-Square-Vegan-Leather-Armchair-with-Nailhead-Trims-and-Button-tufted-Back-Set-of-2-CHYZ0520-NAVY-S2/323233570', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:278 2024-09-27 16:56:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:279 2024-09-27 16:56:44 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Quickway-Imports-Clockswise-Decorative-Modern-Brown-Wall-Clock-with-Black-Metal-Frame-on-Wood-Board-Battery-Operated-Silent-20-Día-QI004253/320274638', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:280 2024-09-27 16:56:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:281 2024-09-27 16:56:47 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Notre-Dame-Façade-by-Marmont-Hill-Framed-Architecture-Art-Print-20-in-x-30-in-LITI5002BFPFL30/324657663', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:282 2024-09-27 16:56:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Grey-Armchair-with-Nailhead-Trims-Set-of-2-CHYZ0521-GREY-S2/323235068', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:283 2024-09-27 16:56:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:284 2024-09-27 16:56:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:285 2024-09-27 16:56:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/9-ft-×-9-ft-Outdoor-Square-Cantilever-LED-Patio-Umbrella-240-g-Solution-Dyed-Fabric-Aluminum-Frame-in-Anthracite-J-99LY-LED/329056210', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:286 2024-09-27 16:56:54 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Notre-Dame-Façade-by-Marmont-Hill-Framed-Architecture-Art-Print-24-in-x-36-in-LITI5002BFPFL36/324657667', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:287 2024-09-27 16:56:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:288 2024-09-27 16:56:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:289 2024-09-27 16:56:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Navy-Armchair-with-Nailhead-Trims-CHYZ0521-NAVY/323235049', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/García-35-in-W-x-35-in-H-White-Modern-Round-Glass-Frame-Wall-Mirror-GLSW010-WHITE/322190014', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:56:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:290 2024-09-27 16:57:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Black-Traditional-Square-Vegan-Leather-Armchair-with-Nailhead-Trims-and-Button-tufted-Back-CHYZ0520-BLACK/323233531', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:291 2024-09-27 16:57:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:292 2024-09-27 16:57:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:293 2024-09-27 16:57:05 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Benjara-Brown-Wood-Top-16-in-Sideboard-with-Cane-Façade-Door-Panels-BM295807/328229596', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:294 2024-09-27 16:57:05 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/York-Wallcoverings-Dark-Grey-Café-Society-Paper-Unpasted-Matte-Wallpaper-27-in-x-27-ft-CI2365/325573415', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:295 2024-09-27 16:57:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:296 2024-09-27 16:57:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:297 2024-09-27 16:57:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Elements-36-in-x-12-in-Metal-Geometric-Wall-Décor-Set-of-2-5282168/325389591', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Vinícius-Black-Armchair-with-Nailhead-Trims-Set-of-2-CHYZ0521-BLACK-S2/323235064', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:298 2024-09-27 16:57:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Blue-Drömma-Teal-Songbirds-and-Sunflowers-Wallpaper-Sample-4111-63007SAM/322509973', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:299 2024-09-27 16:57:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Cecília-Charcoal-Armchair-With-Solid-Wood-Legs-CHM0584-CHARCOAL/322864309', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:13 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Notre-Dame-Façade-by-Marmont-Hill-Framed-Architecture-Art-Print-8-in-x-12-in-LITI5002BFPFL12/324657653', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:13 [scrapy.extensions.logstats] INFO: Crawled 108 pages (at 0 pages/min), scraped 750565 items (at 105969 items/min) 2024-09-27 16:57:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:300 2024-09-27 16:57:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:301 2024-09-27 16:57:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:302 2024-09-27 16:57:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Benjara-Black-and-Brown-Wood-Top-16-in-Sideboard-with-Cane-Façade-Door-Panels-BM295805/328229595', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:303 2024-09-27 16:57:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:304 2024-09-27 16:57:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/52-in-W-×-54-in-D-×-70-9-in-H-Iron-Hammock-Stand-in-Black-SYXY91294037/324052936', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:305 2024-09-27 16:57:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:306 2024-09-27 16:57:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:307 2024-09-27 16:57:24 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Blue-Drömma-Teal-Songbirds-and-Sunflowers-Paper-Non-Pasted-Non-Woven-Matte-Wallpaper-4111-63007/322489132', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:308 2024-09-27 16:57:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:309 2024-09-27 16:57:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/9-ft-×-9-ft-Outdoor-Square-Cantilever-LED-Patio-Umbrella-240-g-Solution-Dyed-Fabric-Aluminum-Frame-in-Navy-Blue-J-99BL-LED/329056207', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NOTRE-DAME-DESIGN-Glen-36-in-H-x-24-in-W-Modern-Rectangular-Black-Framed-Décor-Mirror-NDD22M029/323207464', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:310 2024-09-27 16:57:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JAYDEN-CREATION-Niccolò-Navy-3-Piece-Living-Room-Set-with-Button-tufted-SF0422-MA3288-S2-NAV/321768148', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/31-5-in-W-×-39-4-in-H-White-Wooden-Shoes-Storage-Cabinet-with-Adjustable-Shelves-and-2-Drawers-For-Entryway-Hallway-LBB-KF260056-01-c/323767900', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:311 2024-09-27 16:57:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Grey-Leafy-Vines-Wallpaper-Sample-4143-34018SAM/327154362', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:312 2024-09-27 16:57:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Notre-Dame-Façade-by-Marmont-Hill-Framed-Architecture-Art-Print-12-in-x-18-in-LITI5002BFPFL18/324657721', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:313 2024-09-27 16:57:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:314 2024-09-27 16:57:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Taupe-Leafy-Vines-Non-Pasted-Non-Woven-Paper-Wallpaper-4143-34018/327154440', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:315 2024-09-27 16:57:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:316 2024-09-27 16:57:37 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-18-5-in-x-24-3-in-Empire-Decorative-3D-PVC-Backsplash-Panels-in-Smoked-Pewter-30-Pieces-705812/321723278', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:317 2024-09-27 16:57:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:318 2024-09-27 16:57:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:319 2024-09-27 16:57:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-15-7-in-x-24-4-in-Tongue-Groove-Decorative-PVC-Bathroom-and-Shower-Wall-Tiles-in-Urban-Cement-Dark-Gray-8-Piece-706013/313335189', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:320 2024-09-27 16:57:43 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lindlöv-Light-Grey-Leafy-Vines-Wallpaper-Sample-4143-34017SAM/327154361', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:321 2024-09-27 16:57:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:322 2024-09-27 16:57:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Black-20-in-x-20-in-Throw-Pillow-072919/322138550', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:323 2024-09-27 16:57:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/16-Piece-Ceramic-Kitchen-Cookware-Pots-and-Frying-Sauce-Sauté-Pans-Set-Caribbean-Blue-SNPH002IN441/328268318', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:324 2024-09-27 16:57:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Flax-36-in-W-x-63-in-L-Light-Filtering-Rod-Pocket-Window-Panel-Natural-Crème-Pair-45632/323480292', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:325 2024-09-27 16:57:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-60-in-L-x-16-in-W-Cotton-Valance-in-Coal-Black-Dark-Crème-51929/323922341', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:326 2024-09-27 16:57:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:327 2024-09-27 16:57:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:328 2024-09-27 16:57:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/DEERPORT-DÉCOR-2-Pack-of-16-ft-32-ft-total-80-LED-Blue-Mini-Rope-Light-ML11-MRL16-BL-2/301619421', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-Stripe-36-in-W-x-63-in-L-Light-Filtering-Prairie-Window-Curtain-Panel-in-Crème-Nickel-Pair-69968/324468872', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:57:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:329 2024-09-27 16:58:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:330 2024-09-27 16:58:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Uniquewise-Modern-Farmhouse-Home-Décor-Accents-Boho-Vases-for-Table-Decor-Black-Ceramic-Centerpiece-Vase-for-Home-Decor-Small-QI004358-S/320243240', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Uniquewise-Modern-Farmhouse-Home-Décor-Accents-Boho-Vases-for-Table-Decor-Black-Ceramic-Centerpiece-Vase-for-Home-Decor-Set-of-3-QI004358-3/320243242', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:331 2024-09-27 16:58:04 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Becky-Cameron-Light-Gray-Seed-Stitch-Knit-Acrylic-20-in-x-20-in-Décor-Throw-Pillow-INSRT-TPC-SKN20-LGRAY/329160301', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:332 2024-09-27 16:58:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:333 2024-09-27 16:58:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/48-in-Artificial-Cedar-Topiary-Trees-in-Black-Planter-Perfect-Patio-Entryway-Décor-2-Pack-FL02314-2/326594481', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Flax-36-in-W-x-36-in-L-Light-Filtering-Tier-Window-Panel-in-Natural-Crème-Pair-45637/324886177', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:334 2024-09-27 16:58:08 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Uniquewise-Tall-Modern-Decorative-Floor-Vase-Handmade-Natural-Bamboo-Finish-Contemporary-Home-Décor-Handcrafted-Bamboo-Large-QI003592-L/312276139', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:335 2024-09-27 16:58:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:336 2024-09-27 16:58:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:337 2024-09-27 16:58:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Plush-Red-Plaid-Sherpa-Throw-Blanket-ST50×70PBPHR/316976426', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:338 2024-09-27 16:58:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:339 2024-09-27 16:58:13 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 39 pages/min), scraped 848654 items (at 98089 items/min) 2024-09-27 16:58:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:340 2024-09-27 16:58:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:341 2024-09-27 16:58:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:342 2024-09-27 16:58:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:343 2024-09-27 16:58:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:344 2024-09-27 16:58:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Gather-72-in-L-x-20-in-W-Cotton-Valance-in-Dark-Crème-Coal-Black-Khaki-56765/323922153', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Tea-Cabin-36-in-L-Cotton-Swag-Valance-in-Green-Navy-Crème-Pair-27085/324295857', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/LYNK-PROFESSIONAL-LYNK-PROFESSIONAL-Élite-Pull-Out-Spice-Rack-Organizer-for-Cabinet-8-1-4-in-Wide-Double-Wood-Chrome-432722DS/324765408', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:345 2024-09-27 16:58:22 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-36-in-W-x-24-in-L-Farmhouse-Light-Filtering-Tier-Window-Panel-in-Crème-Nickel-Grey-Pair-69971/324602505', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:346 2024-09-27 16:58:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/4-5-Qt-Stainless-Steel-Sauté-Pan-CW-SUTP-201/328732433', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Uniquewise-Tall-Modern-Decorative-Floor-Vase-Handmade-Natural-Bamboo-Finish-Contemporary-Home-Décor-Handcrafted-Bamboo-Medium-QI003592-M/312275328', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:347 2024-09-27 16:58:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:348 2024-09-27 16:58:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:349 2024-09-27 16:58:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Tea-Cabin-36-in-L-Cotton-Prairie-Swag-Valance-in-Green-Navy-Crème-Pair-8270/324295855', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:350 2024-09-27 16:58:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Finders-Keepers-Natural-Crème-Steel-Grey-Farmhouse-Chicken-Silhouette-6-in-x-6-in-Throw-Pillow-84348/328620215', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BergHOFF-Balance-4-Piece-Ceramic-Ramekin-Crème-Brulé-Set-4-25-7oz-Moonbeam-3950503/328780961', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:351 2024-09-27 16:58:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BergHOFF-Balance-3-1-qt-Nonstick-Recycled-Aluminum-Sauté-Pan-10-25-in-with-Glass-Lid-Sage-3950450/328831462', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Nicole-Miller-Textured-Matelassé-Dove-Grey-Abstract-Light-Filtering-Hidden-Tab-Rod-Pocket-Curtain-50-in-W-x-84-in-L-Set-of-2-EN7023-03-2-84H/310453436', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-Stripe-60-in-L-x-16-in-W-Cotton-Valance-in-Crème-Nickel-Grey-69973/323922235', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:352 2024-09-27 16:58:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:353 2024-09-27 16:58:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NICOLE-MILLER-NEW-YORK-Textured-Matelassé-Blush-Abstract-Light-Filtering-Hidden-Tab-Rod-Pocket-Curtain-50-in-W-x-108-in-L-Set-of-2-YC013585DSNMF1-A261/318757154', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:354 2024-09-27 16:58:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Layered-72-in-L-x-20-in-W-Cotton-Valance-in-Country-Red-Dark-Tan-Dark-Crème-51966/323922347', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:355 2024-09-27 16:58:36 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BergHOFF-Balance-3-1qt-Nonstick-Recycled-Aluminum-Sauté-Pan-10-25-in-with-Glass-Lid-Moonmist-3950426/328831459', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:356 2024-09-27 16:58:37 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-Stripe-40-in-W-x-84-in-L-Light-Filtering-Rod-Pocket-Window-Panel-Crème-Grey-Pair-69965/323406020', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:357 2024-09-27 16:58:39 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Plush-Washed-Denim-Sherpa-Throw-Blanket-ST50×60B/313099557', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:39 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Layered-60-in-L-x-20-in-W-Cotton-Valance-in-Country-Red-Dark-Tan-Dark-Crème-51965/323922348', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:358 2024-09-27 16:58:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-Stripe-36-in-L-Swag-Valance-in-Crème-Nickel-Pair-69970/324295896', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:359 2024-09-27 16:58:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NICOLE-MILLER-NEW-YORK-Textured-Matelassé-Blush-Abstract-Light-Filtering-Hidden-Tab-Rod-Pocket-Curtain-50-in-W-x-84-in-L-Set-of-2-EN7023-04-2-84H/310453532', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:360 2024-09-27 16:58:43 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Flax-40-in-W-x-84-in-L-Ruffled-Light-Filtering-Rod-Pocket-Window-Panel-Natural-Crème-Pair-51351/323480833', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:43 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Wilder-40-in-W-x-84-in-L-Floral-Light-Filtering-Rod-Pocket-Window-Panel-Crème-Blue-Green-Pink-Gold-Pair-81282/323480031', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:44 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BergHOFF-Leo-3-2-qt-Nonstick-Cast-Aluminum-Sauté-Pan-10-25-in-Grey-2219097/328831463', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:361 2024-09-27 16:58:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:362 2024-09-27 16:58:45 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Wilder-Floral-72-in-L-x-18-in-W-Cotton-Valance-in-Antique-Crème-Blue-Green-Pink-Gold-81286/323922220', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:46 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BergHOFF-Balance-3-1-qt-Nonstick-Recycled-Aluminum-Sauté-Pan-10-25-in-with-Glass-Lid-Sage-3950449/328831460', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:363 2024-09-27 16:58:47 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Artificial-White-Berry-Stem-Picks-Wire-Branch-Sprays-for-Xmas-Tree-Décor-24-Pack-AMZ0401WH-1BG/325019599', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/NICOLE-MILLER-NEW-YORK-Textured-Matelassé-Snowflake-Abstract-Light-Filtering-Hidden-Tab-Rod-Pocket-Curtain-50-in-W-x-96-in-L-Set-of-2-EN7024-02-2-96H/310453434', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:364 2024-09-27 16:58:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Modern-Farmhouse-Home-Décor-Accents-Vases-for-Table-Decor-Housewarming-Gift-8-in-Yellow-Mustard-QI004055-MD/318183277', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:365 2024-09-27 16:58:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Calphalon-Classic-5-qt-Nonstick-Aluminum-12-in-All-Purpose-Sauté-Pan-985120075M/326358288', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:366 2024-09-27 16:58:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-36-in-W-x-36-in-L-Light-Filtering-Tier-Window-Panel-in-Dark-Crème-Coal-Black-Pair-51928/324812561', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grain-Sack-36-in-W-x-63-in-L-Light-Filtering-Prairie-Window-Curtain-Panel-in-Crème-Aqua-Pair-70119/324468472', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-36-in-L-Cotton-Swag-Valance-in-Dark-Crème-Coal-Black-Pair-51307/324329251', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:367 2024-09-27 16:58:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:368 2024-09-27 16:58:55 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Patchwork-72-in-L-x-19-in-W-Cotton-Valance-in-Charcoal-Grey-Khaki-Dark-Crème-Black-38040/323922372', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:58:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:369 2024-09-27 16:58:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:370 2024-09-27 16:58:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:371 2024-09-27 16:58:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Frayed-Lattice-36-in-W-x-24-in-L-Light-Filtering-Tier-Window-Panel-in-Demin-Grey-Black-Crème-Pair-80513/324602495', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:372 2024-09-27 16:59:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:373 2024-09-27 16:59:01 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Ruffled-Flax-36-in-W-x-36-in-L-Light-Filtering-Tier-Window-Panel-in-Natural-Crème-Pair-51969/324886212', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:374 2024-09-27 16:59:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/16-Piece-Ceramic-Kitchen-Cookware-Pots-and-Frying-Sauce-Sauté-Pans-Set-Red-SNPH002IN437/328267506', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Ivory-18-in-x-18-in-Throw-Pillow-075439/322138608', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:375 2024-09-27 16:59:04 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-72-in-L-x-16-in-W-Cotton-Valance-in-Coal-Black-Dark-Crème-51930/323922340', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:04 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/StyleWell-Charcoal-Gray-12-lb-Weighted-Blanket-WB-50×70-12C/316976418', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:04 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Flax-36-in-W-x-63-in-L-Ruffled-Light-Filtering-Rod-Pocket-Window-Panel-Natural-Crème-Pair-51352/323480834', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:05 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-40-in-W-x-72-in-L-Light-Filtering-Rod-Pocket-French-Door-Window-Panel-in-Crème-Charcoal-51301/324204796', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:376 2024-09-27 16:59:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:377 2024-09-27 16:59:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:378 2024-09-27 16:59:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:379 2024-09-27 16:59:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Ticking-Stripe-36-in-L-Cotton-Prairie-Swag-Valance-in-Dark-Crème-Coal-Black-Pair-51306/324327190', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Patchwork-90-in-L-x-19-in-W-Cotton-Valance-in-Charcoal-Grey-Khaki-Dark-Crème-Black-38041/323922371', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Wilder-Floral-60-in-L-x-18-in-W-Cotton-Valance-in-Antique-Crème-Blue-Green-Pink-Gold-81285/323922218', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/2-Peice-29-92-in-Faux-Artificial-Ficus-Tree-in-Pot-Artificial-Plant-for-Indoor-Outdoor-Minimalist-Home-Office-Room-Décor-YM-73Tree/326271144', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-Stripe-72-in-L-x-16-in-W-Cotton-Valance-in-Crème-Nickel-Grey-69974/323922234', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Plush-Putty-Sherpa-Throw-Blanket-ST50-×60K/313099552', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:380 2024-09-27 16:59:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:381 2024-09-27 16:59:13 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Navy-18-in-x-18-in-Throw-Pillow-075446/322138582', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:13 [scrapy.extensions.logstats] INFO: Crawled 147 pages (at 0 pages/min), scraped 954602 items (at 105948 items/min) 2024-09-27 16:59:13 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grain-Sack-36-in-W-x-84-in-L-Light-Filtering-Prairie-Window-Curtain-Panel-in-Crème-Aqua-Pair-70118/324468471', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:13 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Frayed-Lattice-36-in-W-x-36-in-L-Light-Filtering-Tier-Window-Panel-in-Demin-Grey-Black-Crème-Pair-80514/324602497', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:382 2024-09-27 16:59:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Simple-Life-Ruffled-Flax-36-in-W-x-24-in-L-Light-Filtering-Tier-Window-Panel-in-Natural-Crème-Pair-51968/324886211', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:383 2024-09-27 16:59:16 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Sawyer-Mill-Patchwork-60-in-L-x-19-in-W-Cotton-Valance-in-Country-Red-Dark-Tan-Dark-Crème-51963/323922370', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:384 2024-09-27 16:59:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:385 2024-09-27 16:59:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Plush-Gray-Sherpa-Throw-Blanket-ST50×60G/313099553', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Wilder-36-in-W-x-63-in-L-Floral-Light-Filtering-Rod-Pocket-Window-Panel-Crème-Blue-Green-Pink-Gold-Pair-81281/323480033', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:386 2024-09-27 16:59:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Uniquewise-Modern-Farmhouse-Home-Décor-Accents-Boho-Vases-for-Table-Decor-Black-Ceramic-Centerpiece-Vase-for-Home-Decor-Large-QI004358-L/320243238', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Grace-Grain-Sack-36-in-W-x-36-in-L-Farmhouse-Light-Filtering-Tier-Window-Panel-in-Crème-Nickel-Grey-Pair-69972/324602507', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:387 2024-09-27 16:59:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:388 2024-09-27 16:59:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:389 2024-09-27 16:59:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:390 2024-09-27 16:59:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Becky-Cameron-Washed-and-Distressed-Cotton-20-in-x-20-in-Décor-Throw-Pillow-INSRT-TPC20-OLIVE/329160314', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:391 2024-09-27 16:59:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Truly-Soft-Forrester-Indoor-Outdoor-12-in-W-x-48-in-L-Red-Green-Crème-Oval-Stripe-PET-Table-Runner-TH3449DG-00/326760813', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:392 2024-09-27 16:59:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:393 2024-09-27 16:59:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:394 2024-09-27 16:59:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Champagne-18-in-x-18-in-Throw-Pillow-072902/322138598', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Finders-Keepers-Natural-Crème-Charcoal-Grey-Farmhouse-Kindness-7-in-x-13-in-Throw-Pillow-84346/328620213', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/StyleWell-Puffer-with-Fleece-Dark-Blue-Gray-and-Blue-Plaid-Nylon-Polyester-Throw-Blanket-PWFT50×60/324404847', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:395 2024-09-27 16:59:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:396 2024-09-27 16:59:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Sherpa-Throw-Midnight-ST50×60M/316523485', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Plush-Blue-Buffalo-Check-Sherpa-Throw-Blanket-ST50×60PB/320662879', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:397 2024-09-27 16:59:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:398 2024-09-27 16:59:38 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Forrester-Indoor-Outdoor-8-in-W-x-24-in-L-Red-Green-Crème-Oval-Stripe-PET-Table-Runner-84123/327610448', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:399 2024-09-27 16:59:39 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Adderley-3-Piece-Café-Plaid-Cotton-Blend-Waffle-Weave-King-Comforter-Set-FA94583-KING/328263522', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:400 2024-09-27 16:59:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Finders-Keepers-Natural-Crème-Steel-Grey-Farmhouse-Cow-Silhouette-6-in-x-6-in-Throw-Pillow-84349/328620216', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/StyleWell-Puffer-with-Fleece-Dark-Blue-Solid-Gray-Nylon-Polyester-Throw-Blanket-PSFT50×60/324404878', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Forrester-Indoor-Outdoor-12-in-W-x-48-in-L-Red-Green-Crème-Oval-Stripe-PET-Table-Runner-84125/327610447', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:401 2024-09-27 16:59:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:402 2024-09-27 16:59:44 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Truly-Soft-Forrester-Indoor-Outdoor-8-in-W-x-24-in-L-Red-Green-Crème-Oval-Stripe-PET-Table-Runner-TH3444GR-00/326762256', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:44 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Marlene-3-Piece-White-Textured-Medallion-Matelassé-Cotton-Full-Queen-Duvet-Cover-Set-DN-18240-FQ/317459196', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:403 2024-09-27 16:59:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:404 2024-09-27 16:59:47 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Matelassé-Organic-Cotton-Twin-XL-Blanket-in-Taupe-BK3303TPTX-4512/328108642', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:405 2024-09-27 16:59:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:406 2024-09-27 16:59:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VHC-Brands-Finders-Keepers-Natural-Crème-Steel-Grey-Farmhouse-HOME-6-in-x-6-in-Throw-Pillow-84351/328620218', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Gray-18-in-x-18-in-Throw-Pillow-075422/322138575', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:407 2024-09-27 16:59:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:408 2024-09-27 16:59:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Mina-Victory-Inspire-Me-Home-Décor-Taupe-18-in-x-18-in-Throw-Pillow-075453/322138548', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:409 2024-09-27 16:59:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Becky-Cameron-Blush-Cozy-Chunky-Knit-Acrylic-20-in-x-20-in-Décor-Throw-Pillow-INSRT-TPC-CHKN20-BLUSH/329160263', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 16:59:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:410 2024-09-27 16:59:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:411 2024-09-27 16:59:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:412 2024-09-27 16:59:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:413 2024-09-27 17:00:01 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/INNOVERA-DÉCOR-BY-PALRAM-24-3-in-x-18-5-in-Empire-Decorative-3D-PVC-Backsplash-Panels-in-Bronze-12-Pieces-706688/316856631', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:414 2024-09-27 17:00:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:415 2024-09-27 17:00:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:416 2024-09-27 17:00:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Emac-Novopeldaño-Mini-Matt-Silver-1-4-in-x-8-1-2-in-Aluminum-Tile-Edging-trim-NPMN1314/324337808', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:417 2024-09-27 17:00:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:418 2024-09-27 17:00:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:419 2024-09-27 17:00:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:420 2024-09-27 17:00:13 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 39 pages/min), scraped 1051435 items (at 96833 items/min) 2024-09-27 17:00:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/EMAC-Novopeldaño-Nori-Cinnamon-1-9-16-in-x-8-1-2-in-ASTRA-Tile-Edging-trim-NPASN1631/324898908', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:421 2024-09-27 17:00:15 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/19-in-Brown-Contemporary-Metal-Winding-Ivy-Table-Desk-Lamp-with-Fabric-Shade-for-Home-Décor-CWT-2006-BW/325853256', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:422 2024-09-27 17:00:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:423 2024-09-27 17:00:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:424 2024-09-27 17:00:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:425 2024-09-27 17:00:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/EMAC-Novopeldaño-Nori-Cement-1-9-16-in-x-8-1-2-in-ASTRA-Tile-Edging-Trim-NPASN1641/324899085', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:426 2024-09-27 17:00:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ZUHNË-Modena-28-in-Stainless-Steel-Undermount-Kitchen-Sink-with-Accessories-16-Gauge-Modena28/314191234', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:427 2024-09-27 17:00:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Siavonce-30-00-in-D-×-20-00-in-W-Farmhouse-Apron-Front-White-Ceramic-Kitchen-Sink-ZX-100938/326756889', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:428 2024-09-27 17:00:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:429 2024-09-27 17:00:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/EMAC-Novopeldaño-Nori-Almond-1-9-16-in-x-8-1-2-in-ASTRA-Tile-Edging-Trim-NPASN1681/324898454', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:430 2024-09-27 17:00:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:431 2024-09-27 17:00:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:432 2024-09-27 17:00:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:433 2024-09-27 17:00:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:434 2024-09-27 17:00:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:435 2024-09-27 17:00:35 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Grower-s-Choice-Aglaonema-Chinese-Evergreen-Indoor-Plant-in-6-in-White-Décor-Pot-Avg-Shipping-Height-1-2-ft-2-Pack-CO-AGS6-3-VI-WH/318745808', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:436 2024-09-27 17:00:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:437 2024-09-27 17:00:38 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/15-75-in-W-×-39-37-in-D-×-70-87-in-H-Walnut-Freestanding-Large-Kitchen-Pantry-Storage-Cabinet-with-Drawers-Shelves-SNSA22IN169/327649352', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:438 2024-09-27 17:00:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:439 2024-09-27 17:00:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Lifeproof-with-Petproof-Technology-Gazelle-II-Crème-Brulee-Beige-55-oz-Triexta-Texture-Installed-Carpet-0640D-27-12/300387441', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Sago-Palm-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-Tall-2-Pack-CO-SAGO-3-VI-WH/318747128', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:440 2024-09-27 17:00:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Glitzhome-42-in-H-St-Patrick-s-Wooden-Gonme-Porch-Décor-GH2032700001/325009946', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/TOLEDO-Antique-Brass-Privacy-Málaga-Knob-CV1920MAUS5/202530837', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Merola-Tile-Manises-Décor-Cuero-13-1-8-in-x-13-1-8-in-Ceramic-Floor-and-Wall-Take-Home-Tile-Sample-S1FEM13MNCD/326752905', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:441 2024-09-27 17:00:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:442 2024-09-27 17:00:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:443 2024-09-27 17:00:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:444 2024-09-27 17:00:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:445 2024-09-27 17:00:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/TOLEDO-Toledo-stainless-steel-Málaga-passage-Hall-Closet-Door-Knob-CV1910MAUS32D/307377043', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:446 2024-09-27 17:00:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Neanthebella-Indoor-Palm-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-Tall-2-Pack-CO-NP07-3-VI-WH/318745730', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Philodendron-Selloum-Indoor-Plant-in-10-in-Gray-Décor-Pot-Avg-Shipping-Height-2-3-ft-Tall-CO-PS10-3-CYL/319268575', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:447 2024-09-27 17:00:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:448 2024-09-27 17:00:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:449 2024-09-27 17:00:55 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Sago-Palm-Indoor-Plant-in-10-in-Natural-Décor-Basket-Avg-Shipping-Height-2-3-ft-Tall-CO-RV10-3-SEA/319495687', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:450 2024-09-27 17:00:56 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Champs-Élysees-Collection-2-3-4-in-69-mm-x-13-16-in-20-mm-Matte-Black-Traditional-Cabinet-Knob-BP10569900/204695503', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:56 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Zamioculcas-Zamiifolia-ZZ-Indoor-Plant-in-10-in-Natural-Décor-Basket-Avg-Shipping-Height-2-3-ft-Tall-CO-ZC10-3-SEA/318768796', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:00:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:451 2024-09-27 17:00:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:452 2024-09-27 17:00:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Grower-s-Choice-Calathea-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-10-in-2-Pack-CO-CAL6-3-VI-WH/318745737', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:453 2024-09-27 17:01:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Nearly-Natural-20-in-Holiday-Merry-Christmas-Door-Wall-Hanger-with-Pinecones-and-Berries-Gingham-Plaid-Bow-Wall-Art-Décor-7148/321542121', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:454 2024-09-27 17:01:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROPPE-Adelleÿ0-38-in-Thick-x-2-75-in-Wide-x-78-in-Length-Hardwood-Stair-Nose-HSN2006/320137550', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:455 2024-09-27 17:01:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rain-Forest-15-7-in-Dia-x-12-6-in-H-Antúrio-Antique-Terracotta-Plastic-Planter-040-032-02/327862516', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Grower-s-Choice-Sansevieria-Indoor-Snake-Plant-in-6-in-White-Ribbed-Décor-Pot-Avg-Shipping-Height-1-2-ft-2-Pack-CO-SL07-3-VI-WH/318745813', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Emac-Novopeldaño-Mini-Matt-Black-1-4-in-x-8-1-2-in-Aluminum-Tile-Edging-trim-NPMN9014/324337842', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:456 2024-09-27 17:01:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:457 2024-09-27 17:01:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Merola-Tile-Chalk-Décor-Topos-3-in-x-11-3-4-in-Ceramic-Wall-Take-Home-Tile-Sample-S1WBT12CTO/323644241', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:458 2024-09-27 17:01:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:459 2024-09-27 17:01:08 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Philodendron-Selloum-Indoor-Plant-in-10-in-Natural-Décor-Basket-Avg-Shipping-Height-2-3-ft-Tall-CO-PS1010-3-SEA/319495547', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:09 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Peace-Lily-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-Tall-2-Pack-CO-SY06-3-VI-WH/318745853', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:09 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Bird-s-Nest-Fern-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-Tall-2-Pack-CO-BRDF-3-VI-WH/318745767', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:460 2024-09-27 17:01:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:461 2024-09-27 17:01:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:462 2024-09-27 17:01:13 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 0 pages/min), scraped 1157665 items (at 106230 items/min) 2024-09-27 17:01:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:463 2024-09-27 17:01:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:464 2024-09-27 17:01:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:465 2024-09-27 17:01:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:466 2024-09-27 17:01:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Yucca-Cane-Indoor-Plant-in-8-75-White-Décor-Pot-Avg-Shipping-Height-2-3-ft-Tall-10YUCREAMOD/307885320', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:467 2024-09-27 17:01:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Grower-s-Choice-Sansevieria-Indoor-Snake-Plant-in-10-in-White-Décor-Pot-Avg-Shipping-Height-1-2-ft-Tall-10SANSLCREAMMOD/307930288', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:468 2024-09-27 17:01:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Roebellini-Pygmy-Date-Palm-Indoor-Plant-in-10-in-Gray-Décor-Pot-Avg-Shipping-Height-3-4-ft-Tall-CO-PXR-3-CYL/319267721', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:469 2024-09-27 17:01:22 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Solar-Outdoor-Lights-43-in-Premium-99-LEDs-Solar-Torch-Lights-for-Garden-Décor-2-Pack-B07DW468T1/326472158', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:22 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Roebellini-Pygmy-Date-Palm-Indoor-Plant-in-10-in-Natural-Décor-Basket-Avg-Shipping-Height-3-4-ft-Tall-CO-PXR-3-SEA/319495564', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/24-in-Peanuts-Led-3D-Prelit-Yard-Décor-Skating-Snoopy-PW-36246/325909963', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:470 2024-09-27 17:01:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:471 2024-09-27 17:01:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:472 2024-09-27 17:01:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:473 2024-09-27 17:01:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:474 2024-09-27 17:01:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Aglaonema-Chinese-Evergreen-Indoor-Plant-in-9-25-in-Natural-Décor-Basket-Avg-Shipping-Height-2-3-ft-Tall-CO-AA10-3-SEA/319495684', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:475 2024-09-27 17:01:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Bonnie-Plants-19-3-oz-Habañero-Hot-Pepper-Plant-3100/300718715', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:476 2024-09-27 17:01:33 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ZUHNË-Modena-21-in-Stainless-Steel-Undermount-Kitchen-Sink-with-Accessories-16-Gauge-Single-Bowl-for-24-in-Cabinet-Modena21/314486147', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:477 2024-09-27 17:01:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:478 2024-09-27 17:01:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:479 2024-09-27 17:01:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:480 2024-09-27 17:01:38 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rain-Forest-20-in-Dia-x-18-in-H-Antúrio-Rolled-Rim-Plastic-Planter-R-0302-050-045-02/326750858', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:481 2024-09-27 17:01:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Nearly-Natural-20-in-Holiday-Merry-Christmas-Door-Wall-Hanger-with-Pine-and-Berries-Stripped-Bow-Wall-Art-Décor-7147/321542120', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/2-Tier-7-08-in-D-×-15-35-in-W-Under-Sink-Organizer-Storage-Drawer-Basket-Organizer-with-Hooks-Hanging-Cup-ABS-SNSA22IN495/328886105', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:482 2024-09-27 17:01:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Dracaena-Indoor-Plant-in-10-in-White-Wood-Décor-Pot-Avg-Shipping-Height-2-3-ft-Tall-CO-DMC10-CYLSTD/320662736', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:483 2024-09-27 17:01:42 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Butterfly-Cat-Metal-Garden-Cutout-Wrought-Iron-Insert-Solar-Decoration-For-Outdoor-Décor-2-pack-GCWIIBC2P/328678226', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:484 2024-09-27 17:01:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:485 2024-09-27 17:01:45 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Costa-Farms-Kimberly-Queen-Fern-Indoor-Outdoor-Plant-in-9-25-in-Natural-Décor-Basket-Avg-Shipping-Height-1-2-ft-Tall-CO-KQ10-3-SEA/318768791', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:486 2024-09-27 17:01:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:487 2024-09-27 17:01:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Ponytail-Palm-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-Tall-2-Pack-CO-PONY-3-VI-WH/318745832', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:488 2024-09-27 17:01:50 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ZUHNË-Roma-Brushed-16-Gauge-Stainless-Steel-32-in-Double-Bowl-Undermount-Kitchen-Sink-with-Bottom-Grid-Roma32/315675108', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:489 2024-09-27 17:01:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Sunflower-And-Cat-Metal-Garden-Cutout-Wrought-Iron-Insert-Solar-Decoration-For-Outdoor-Décor-2-pack-GCIISC2P/328678165', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:490 2024-09-27 17:01:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/1-71-Pint-Organic-Jalapeño-Pepper-Plants-4-Pack-PEPJAL000OVQV/314113343', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:491 2024-09-27 17:01:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:492 2024-09-27 17:01:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:493 2024-09-27 17:01:56 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Prévost-Collection-1-1-4-in-32-mm-Traditional-Antique-Nickel-Square-Cabinet-Knob-BP78535143/205417631', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:494 2024-09-27 17:01:57 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Vigoro-Zamioculcas-Zamiifolia-ZZ-Indoor-Plant-in-6-in-White-Ribbed-Plastic-Décor-Planter-Avg-Shipping-Height-1-2-ft-2-Pack-CO-ZZ-VI-WH/318745760', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Ornament-Collection-13-in-x-18-5-in-Pietà-Garden-Flag-Double-Sided-Religious-Decorative-Vertical-Flags-HDG192322-BO/318385113', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:01:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:495 2024-09-27 17:02:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:496 2024-09-27 17:02:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rain-Forest-18-5-in-Dia-x-18-5-in-H-Milão-Antique-Camurca-Plastic-Planter-047-047-05/327863554', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:497 2024-09-27 17:02:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rain-Forest-30-in-Antúrio-Rolled-Rim-Plastic-Planter-R-0302-076-068-02/326751672', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:498 2024-09-27 17:02:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Rosemère-Collection-1-5-16-in-33-mm-Classic-Antique-English-Square-Cabinet-Knob-BP76533AE/204078106', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:499 2024-09-27 17:02:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:500 2024-09-27 17:02:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Rosemère-Collection-1-5-16-in-33-mm-Classic-Brushed-Nickel-Square-Cabinet-Knob-BP76533195/204078105', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:501 2024-09-27 17:02:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:502 2024-09-27 17:02:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:503 2024-09-27 17:02:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/14-7-in-Gray-Contemporary-Ceramic-Stacking-Stones-Table-Desk-Lamp-for-Home-Décor-CWT-2015-GY/325853260', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:504 2024-09-27 17:02:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Verónica-10-Light-Antique-Black-and-Metallic-Gold-Sputnik-Chandelier-with-No-Bulbs-Included-FD-3387-CAE/327872110', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Prévost-Collection-1-1-4-in-32-mm-Traditional-Brushed-Oil-Rubbed-Bronze-Square-Cabinet-Knob-BP78535BORB/205417630', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:505 2024-09-27 17:02:13 [scrapy.extensions.logstats] INFO: Crawled 186 pages (at 0 pages/min), scraped 1264393 items (at 106728 items/min) 2024-09-27 17:02:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:506 2024-09-27 17:02:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:507 2024-09-27 17:02:15 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Champs-Élysees-Collection-2-3-16-in-55-mm-x-13-16-in-20-mm-Oil-Rubbed-Bronze-Traditional-Cabinet-Knob-BP10555ORB/205417455', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:508 2024-09-27 17:02:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/VOLßN-5-Light-Aged-Brass-Linear-Pendant-6617-5-80/326047544', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:509 2024-09-27 17:02:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Rosemère-Collection-12-in-305-mm-Classic-Brushed-Oil-Rubbed-Bronze-Rectangular-Appliance-Pull-BP765304BORB/301382684', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:510 2024-09-27 17:02:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:511 2024-09-27 17:02:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:512 2024-09-27 17:02:24 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Richelieu-Hardware-Champs-Élysees-Collection-2-3-16-in-55-mm-x-13-16-in-20-mm-Matte-Black-Traditional-Cabinet-Knob-BP10555900/204695500', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:513 2024-09-27 17:02:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:514 2024-09-27 17:02:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:515 2024-09-27 17:02:27 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Volßn-1-Light-Aged-Brass-Pendant-3317-80/326047608', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:516 2024-09-27 17:02:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:517 2024-09-27 17:02:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:518 2024-09-27 17:02:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:519 2024-09-27 17:02:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:520 2024-09-27 17:02:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/22-05-in-W×22-05-in-D×39-57-in-Gray-Bath-Vanity-Cabinet-with-1-White-Sink-White-Marble-Countertop-Fully-Assembled-HDSA17IN215/328304188', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:521 2024-09-27 17:02:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:522 2024-09-27 17:02:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:523 2024-09-27 17:02:44 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Brabantia-Ground-Spike-Metal-for-outdoor-retractable-clothesline-Size-3-Ø2-Inch-Galvanized-311468/323181597', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:45 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Sunnydaze-Decor-Façade-du-Soleil-Reinforced-Concrete-Bird-Bath-26-in-FWD-495/317035141', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:524 2024-09-27 17:02:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:525 2024-09-27 17:02:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:526 2024-09-27 17:02:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-Top-804160M-FY-LWN/326214391', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:527 2024-09-27 17:02:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:528 2024-09-27 17:02:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:529 2024-09-27 17:02:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Solar-Outdoor-Lights-Extra-Bright-Solar-Outdoor-Torch-Lights-for-Garden-Décor-12-Pack-B0B8CRZDDW/326472511', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:530 2024-09-27 17:02:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-803860-FY-LW-NM/326051118', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:02:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:531 2024-09-27 17:02:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:532 2024-09-27 17:02:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:533 2024-09-27 17:02:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:534 2024-09-27 17:03:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:535 2024-09-27 17:03:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:536 2024-09-27 17:03:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-48-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803848-FW-RG-NM/325922972', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:03 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Glacier-Bay-Faucet-Ceramic-Cartridge-Assembly-External-Diameter-35-mm-Ø3-9-mm-RP90097/207093806', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:537 2024-09-27 17:03:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:538 2024-09-27 17:03:05 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-84-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-Top-804184-FW-RG-NM/326214396', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:539 2024-09-27 17:03:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:540 2024-09-27 17:03:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:541 2024-09-27 17:03:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Home-Decorators-Collection-Sherpa-Throw-Oatmeal-ST50×60O/316523487', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Venti-Air-12-in-W-x-06-in-H-Adjustable-Single-Deflection-Radius-Mount-Diffuser-Grille-for-10-in-Día-Spiral-Pipe-HSP120610/316980134', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Solar-Lights-Outdoor-Premium-99-LEDs-Solar-Torch-Light-with-Flickering-Flame-Outdoor-Décor-4-Pack-B07PXS6GKD/326472057', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:542 2024-09-27 17:03:13 [scrapy.extensions.logstats] INFO: Crawled 221 pages (at 35 pages/min), scraped 1360984 items (at 96591 items/min) 2024-09-27 17:03:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:543 2024-09-27 17:03:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Swiss-Madison-Fantôme-H-0-8-1-6-GPF-Dual-Flush-Toilet-Tank-Only-in-White-SM-WC428/323577574', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:544 2024-09-27 17:03:16 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/440-lbs-Capacity-Easy-Move-Foldable-Push-Cart-with-2-×-Fixed-and-Wheels-2-×-360-Wheels-RY-G-USBO4510/322824997', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:545 2024-09-27 17:03:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Swiss-Madison-Fantôme-H-1-1-1-6-GPF-Dual-Flush-Toilet-Tank-Only-Carrier-System-with-Top-Flush-for-Back-to-Wall-Toilet-in-White-SM-WC328/323777260', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:546 2024-09-27 17:03:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Glacier-Bay-Faucet-Ceramic-Cartridge-Assembly-External-Diameter-25-mm-Ø8-8-mm-RP90115/301158148', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-84-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803884-FW-RG-NM/325922981', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-72-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-Top-804172-FY-LW-NM/326214394', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:547 2024-09-27 17:03:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:548 2024-09-27 17:03:20 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-36-in-W-x-22-in-D-x-34-in-H-Free-standing-Single-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-Top-804136-FY-LW-NM/326214385', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:549 2024-09-27 17:03:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:550 2024-09-27 17:03:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-and-Mirror-803860M-FW-RG/325922897', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:551 2024-09-27 17:03:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:552 2024-09-27 17:03:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Aliénor-Machine-Washable-Blue-8-ft-x-10-ft-Tribal-Area-Rug-GRHN04A-8010/326900753', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:553 2024-09-27 17:03:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:554 2024-09-27 17:03:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:555 2024-09-27 17:03:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Órla-Machine-Washable-Rust-4-ft-x-6-ft-Southwestern-Area-Rug-BIRV97A-406/326678974', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:556 2024-09-27 17:03:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Noémie-Tribal-Synbols-Tasseled-Ivory-5-ft-x-8-ft-Modern-Area-Rug-SVBR06A-508/326899554', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:557 2024-09-27 17:03:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:558 2024-09-27 17:03:34 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-36-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-and-Mirror-803836-FN-LW/325922890', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:559 2024-09-27 17:03:36 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-84-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-and-Mirror-803884-FW-RG/325922903', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:560 2024-09-27 17:03:37 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Órla-Tribal-Bordered-Machine-Washable-Rust-8-ft-x-10-ft-Area-Rug-BIRV97A-8010/326678412', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:561 2024-09-27 17:03:38 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-24-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-and-Mirror-803824-FN-LW/325922886', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:562 2024-09-27 17:03:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:563 2024-09-27 17:03:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:564 2024-09-27 17:03:43 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-24-in-W-x-22-in-D-x-34-in-H-Free-standing-Single-Bathroom-Vanity-in-Fir-Wood-Black-with-Composite-top-804124-FB-LW-NM/326214380', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:565 2024-09-27 17:03:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:566 2024-09-27 17:03:46 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-48-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-and-Mirror-803848-FN-LW/325922893', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:567 2024-09-27 17:03:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:568 2024-09-27 17:03:47 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-72-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-top-and-Mirror-804172-FB-LW/326214368', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:569 2024-09-27 17:03:49 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-24-in-W-x-22-in-D-x-34-in-H-Free-standing-Single-Bathroom-Vanity-in-Fir-Wood-Grey-with-Composite-top-804124-FY-LW-NM/326214382', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:570 2024-09-27 17:03:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Aliénor-Machine-Washable-Blue-4-ft-x-6-ft-Tribal-Area-Rug-GRHN04A-406/326900729', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:571 2024-09-27 17:03:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:572 2024-09-27 17:03:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Glacier-Bay-Faucet-Ceramic-Cartridge-Assembly-External-Diameter-35-mm-Ø4-8-mm-RP90118/301158214', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:573 2024-09-27 17:03:55 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-84-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-top-and-Mirror-804184-FB-LW/326214371', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:574 2024-09-27 17:03:57 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-and-Mirror-803860M-FN-LW/325922896', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:03:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:575 2024-09-27 17:03:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:576 2024-09-27 17:04:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:577 2024-09-27 17:04:01 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-72-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-top-and-Mirror-804172-FW-RG/326214369', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:578 2024-09-27 17:04:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:579 2024-09-27 17:04:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:580 2024-09-27 17:04:05 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Glacier-Bay-Faucet-Ceramic-Cartridge-Assembly-External-Diameter-25-mm-Ø7-6-mm-RP90003/206116616', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:581 2024-09-27 17:04:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-and-Mirror-803860-FY-LW/326051171', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-36-in-W-x-22-in-D-x-34-in-H-Free-standing-Single-Bathroom-Vanity-in-Fir-Wood-White-withg-Gray-Composite-Top-804136-FW-RG-NM/326214384', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:582 2024-09-27 17:04:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:583 2024-09-27 17:04:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-24-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-803824-FY-LW-NM/325922967', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:584 2024-09-27 17:04:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-top-and-Mirror-804160M-FY-LW/326214367', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:585 2024-09-27 17:04:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-84-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-803884-FN-LW-NM/325922980', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/14-96-in-W×7-28-in-D×20-28-in-H-9-Drawers-Gray-Bath-Vanity-Cabinet-with-1-Sink-Marble-Standard-Top-Fully-Assembled-HDSA17IN213/328304176', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:12 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-48-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-and-Mirror-803848-FY-LW/325922895', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:586 2024-09-27 17:04:13 [scrapy.extensions.logstats] INFO: Crawled 221 pages (at 0 pages/min), scraped 1465833 items (at 104849 items/min) 2024-09-27 17:04:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-24-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803824-FW-RG-NM/325922966', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:587 2024-09-27 17:04:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:588 2024-09-27 17:04:16 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-Top-804160M-FB-LWN/326214389', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:589 2024-09-27 17:04:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:590 2024-09-27 17:04:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:591 2024-09-27 17:04:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Úna-Lattice-Stain-Resistant-Machine-Washable-Beige-9-ft-x-12-ft-Area-Rug-HJTH02A-9012/326587186', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:592 2024-09-27 17:04:22 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-48-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-top-and-Mirror-804148-FY-LW/326214364', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:593 2024-09-27 17:04:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-36-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-top-and-Mirror-804136-FY-LW/326214361', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:594 2024-09-27 17:04:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:595 2024-09-27 17:04:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-24-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-and-Mirror-803824-FY-LW/325922888', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:596 2024-09-27 17:04:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:597 2024-09-27 17:04:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:598 2024-09-27 17:04:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Renée-Machine-Washable-Multicolor-5-ft-x-8-ft-Tribal-Area-Rug-GRHN08A-508/326678799', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:599 2024-09-27 17:04:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-Top-804160M-FW-RGN/326214390', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:33 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-top-and-Mirror-804160M-FB-LW/326214365', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:600 2024-09-27 17:04:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:601 2024-09-27 17:04:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:602 2024-09-27 17:04:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:603 2024-09-27 17:04:38 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-21-7-in-W-x-15-7-in-D-x-72-in-H-Brown-Storage-Linen-Cabinet-for-Bathroom-Kitchen-and-Living-Room-803822-SCA-FN/326165303', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:604 2024-09-27 17:04:40 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-21-7-in-W-x-15-7-in-D-x-71-9-in-H-Floor-White-Linen-Cabinet-for-Bathroom-Kitchen-and-Living-Room-804122-SCA-FW/326324408', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:605 2024-09-27 17:04:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-72-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-803872-FN-LW-NM/325922977', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:606 2024-09-27 17:04:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:607 2024-09-27 17:04:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:608 2024-09-27 17:04:45 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/27-60-in-W-×-63-80-in-H-×-7-70-in-D-White-Over-The-Toilet-Bathroom-Cabinet-Adjustable-Shelf-Collect-Cabinet-RS-27OTTS2-WB/324147419', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:609 2024-09-27 17:04:47 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/14-96-in-W-×-7-28-in-D-×-20-28-in-H-9-Drawers-White-Bath-Vanity-Cabinet-1-Sink-Marble-Countertop-Fully-Assembled-HDSA17IN214/328304187', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:610 2024-09-27 17:04:48 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Aliénor-Machine-Washable-Blue-5-ft-x-8-ft-Tribal-Area-Rug-GRHN04A-508/326900683', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:611 2024-09-27 17:04:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:612 2024-09-27 17:04:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Inés-Gray-7-ft-x-9-ft-Tribal-Indoor-Outdoor-Area-Rug-KKPR07B-6709/326679132', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:51 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-72-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-top-and-Mirror-804172-FY-LW/326214370', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:613 2024-09-27 17:04:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rugs-America-Rugs-America-Café-Royal-2-X-8ft-Indoor-Area-Rug-RA31114/325258971', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:52 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-84-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-and-Mirror-803884-FY-LW/325922904', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:614 2024-09-27 17:04:53 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-24-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-and-Mirror-803824-FW-RG/325922887', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:54 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-803860M-FY-LWN/325922976', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:615 2024-09-27 17:04:55 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-48-in-W-x-22-in-D-x-34-in-H-Free-Standing-Single-Sink-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-Top-804148-FY-LW-NM/326214388', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:616 2024-09-27 17:04:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:617 2024-09-27 17:04:58 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-and-Mirror-803860-FW-RG/326051170', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:04:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:618 2024-09-27 17:05:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803860-FW-RG-NM/326051117', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/Rugs-America-Rugs-America-Café-Royal-2-X-4ft-Indoor-Area-Rug-RA31113/325258969', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-36-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803836-FW-RG-NM/325922969', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:619 2024-09-27 17:05:00 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-24-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-Black-with-Composite-top-and-Mirror-804124-FB-LW/326214356', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:01 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-36-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-top-and-Mirror-804136-FB-LW/326214359', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:620 2024-09-27 17:05:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:621 2024-09-27 17:05:04 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/14-96-in-W-×-7-28-in-D-×-20-28-in-H-5-Drawers-White-Bath-Vanity-Cabinet-with-1-Sink-Marble-Countertop-Fully-Assembled-HDSA17IN212/328304175', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:622 2024-09-27 17:05:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-48-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-top-and-Mirror-804148-FW-RG/326214363', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-803860M-FW-RGN/325922975', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:623 2024-09-27 17:05:07 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Úna-Lattice-Stain-Resistant-Machine-Washable-Beige-5-ft-x-8-ft-Area-Rug-HJTH02A-508/326587180', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:624 2024-09-27 17:05:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:625 2024-09-27 17:05:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-84-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-top-and-Mirror-804184-FW-RG/326214372', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:626 2024-09-27 17:05:11 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Grey-with-White-Composite-Stone-Top-and-Mirror-803860M-FY-LW/325922898', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:627 2024-09-27 17:05:13 [scrapy.extensions.logstats] INFO: Crawled 221 pages (at 0 pages/min), scraped 1570496 items (at 104663 items/min) 2024-09-27 17:05:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:628 2024-09-27 17:05:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Véronique-Transitional-Vines-Wool-Navy-5-ft-x-8-ft-Modern-Area-Rug-NECR05A-508/326900746', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:629 2024-09-27 17:05:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:630 2024-09-27 17:05:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:631 2024-09-27 17:05:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-21-7-in-W-x-15-7-in-D-x-72-in-H-Floor-Gray-Linen-Cabinet-803822-SCA-FY/326165305', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Úna-Lattice-Stain-Resistant-Machine-Washable-Beige-2-ft-6-in-x-8-ft-Runner-Rug-HJTH02A-2608/326587163', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:632 2024-09-27 17:05:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:633 2024-09-27 17:05:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:634 2024-09-27 17:05:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:635 2024-09-27 17:05:24 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-72-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-and-Mirror-803872-FN-LW/325922899', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:636 2024-09-27 17:05:25 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-60-in-W-x-22-in-D-x-34-in-H-Double-Bathroom-Vanity-in-Fir-Wood-White-with-Gray-Composite-top-and-Mirror-804160M-FW-RG/326214366', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:637 2024-09-27 17:05:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-36-in-W-x-22-in-D-x-34-in-H-Single-Sink-Bath-Vanity-in-Fir-Wood-White-with-Grey-Composite-Stone-Top-and-Mirror-803836-FW-RG/325922891', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:638 2024-09-27 17:05:28 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/16-in-W-×-11-6-in-D-×-21-30-in-H-Single-Sink-Wall-Mounted-Bath-Vanity-in-Black-Chestnut-with-White-Ceramic-Top-QNM-2916BCT/328773335', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:639 2024-09-27 17:05:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:640 2024-09-27 17:05:31 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-84-in-W-x-22-in-D-x-34-in-H-Free-standing-Double-Bathroom-Vanity-in-Fir-Wood-Grey-with-White-Composite-Top-804184-FY-LW-NM/326214397', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:641 2024-09-27 17:05:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Úna-Stain-Resistant-Machine-Washable-Tan-8-ft-x-10-ft-Moroccan-Area-Rug-HJTH02A-8010/326587098', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:33 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-21-7-in-W-x-15-7-in-D-x-72-in-H-White-Storage-Linen-Cabinet-for-Bathroom-Kitchen-and-Living-Room-803822-SCA-FW/326165304', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:642 2024-09-27 17:05:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:643 2024-09-27 17:05:36 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-León-60-in-W-x-22-in-D-x-34-in-H-Double-Sink-Bath-Vanity-in-Fir-Wood-Brown-with-White-Composite-Stone-Top-803860M-FN-LWN/325922974', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:644 2024-09-27 17:05:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:645 2024-09-27 17:05:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:646 2024-09-27 17:05:39 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/ROSWELL-Cádiz-48-in-W-x-22-in-D-x-34-in-H-Single-Bathroom-Vanity-in-Fir-Wood-Black-with-White-Composite-top-and-Mirror-804148-FB-LW/326214362', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:647 2024-09-27 17:05:41 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/nuLOOM-Joëlle-Light-Gray-8-ft-x-10-ft-Geometric-Tasseled-Area-Rug-RZET02A-8010/326900725', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:648 2024-09-27 17:05:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:649 2024-09-27 17:05:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:650 2024-09-27 17:05:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:651 2024-09-27 17:05:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:652 2024-09-27 17:05:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:653 2024-09-27 17:05:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:654 2024-09-27 17:05:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:655 2024-09-27 17:05:59 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Sunbright-Yellow-026811/313322836', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:05:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:656 2024-09-27 17:06:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:657 2024-09-27 17:06:02 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Sapphire-Blue-018741/313320611', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:658 2024-09-27 17:06:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:659 2024-09-27 17:06:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:660 2024-09-27 17:06:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:661 2024-09-27 17:06:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:662 2024-09-27 17:06:08 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Sangria-082331/313320812', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:663 2024-09-27 17:06:10 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Senorita-Margarita-026817/313320723', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:664 2024-09-27 17:06:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:665 2024-09-27 17:06:13 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 37 pages/min), scraped 1665317 items (at 94821 items/min) 2024-09-27 17:06:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:666 2024-09-27 17:06:14 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Pink-090480/315616469', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:667 2024-09-27 17:06:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:668 2024-09-27 17:06:17 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Calabaza-Orange-026813/313322843', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:669 2024-09-27 17:06:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Sapphire-Blue-026819/313322856', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:670 2024-09-27 17:06:19 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Tangerine-026812/313320755', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:671 2024-09-27 17:06:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Rainforest-Green-026822/313322866', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:21 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Santa-Fe-Red-026814/313322847', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:672 2024-09-27 17:06:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:673 2024-09-27 17:06:23 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Mantilla-Black-013821/313320643', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:24 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Shadow-Grey-082335/313320636', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:674 2024-09-27 17:06:25 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Burro-Brown-082332/313320628', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:675 2024-09-27 17:06:26 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Tangerine-066365/313320881', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:676 2024-09-27 17:06:28 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Baja-Blue-026820/313322859', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Shadow-Grey-026826/313322878', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:677 2024-09-27 17:06:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Teal-090483/315616470', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:29 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Blanco-Blanco-026827/313320688', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Rainforest-Green-013820/313320624', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:30 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-1-2-oz-Blue-Violet-090482/315616468', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:678 2024-09-27 17:06:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:679 2024-09-27 17:06:32 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/JACQUARD-Piñata-Alcohol-Ink-4-oz-Havana-Brown-082334/313320631', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:680 2024-09-27 17:06:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:681 2024-09-27 17:06:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:682 2024-09-27 17:06:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:683 2024-09-27 17:06:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:684 2024-09-27 17:06:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:685 2024-09-27 17:06:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:686 2024-09-27 17:06:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:687 2024-09-27 17:06:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:688 2024-09-27 17:06:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:689 2024-09-27 17:06:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:690 2024-09-27 17:06:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:691 2024-09-27 17:06:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:692 2024-09-27 17:06:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:693 2024-09-27 17:06:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:694 2024-09-27 17:06:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:695 2024-09-27 17:06:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:696 2024-09-27 17:06:57 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BEHR-PREMIUM-PLUS-8-oz-MQ2-33-Parisian-Café-Semi-Gloss-Interior-Exterior-Paint-Primer-Color-Sample-B330416/326267315', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:06:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:697 2024-09-27 17:06:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:698 2024-09-27 17:07:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:699 2024-09-27 17:07:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:700 2024-09-27 17:07:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:701 2024-09-27 17:07:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:702 2024-09-27 17:07:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:703 2024-09-27 17:07:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:704 2024-09-27 17:07:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:705 2024-09-27 17:07:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:706 2024-09-27 17:07:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:707 2024-09-27 17:07:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:708 2024-09-27 17:07:13 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 0 pages/min), scraped 1771889 items (at 106572 items/min) 2024-09-27 17:07:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:709 2024-09-27 17:07:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:710 2024-09-27 17:07:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:711 2024-09-27 17:07:19 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:712 2024-09-27 17:07:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:713 2024-09-27 17:07:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:714 2024-09-27 17:07:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:715 2024-09-27 17:07:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:716 2024-09-27 17:07:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:717 2024-09-27 17:07:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:718 2024-09-27 17:07:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:719 2024-09-27 17:07:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:720 2024-09-27 17:07:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:721 2024-09-27 17:07:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:722 2024-09-27 17:07:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:723 2024-09-27 17:07:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:724 2024-09-27 17:07:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:725 2024-09-27 17:07:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:726 2024-09-27 17:07:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:727 2024-09-27 17:07:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:728 2024-09-27 17:07:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:729 2024-09-27 17:07:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:730 2024-09-27 17:07:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:731 2024-09-27 17:07:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:732 2024-09-27 17:07:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:733 2024-09-27 17:07:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:734 2024-09-27 17:07:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:735 2024-09-27 17:07:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:736 2024-09-27 17:07:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:737 2024-09-27 17:07:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:738 2024-09-27 17:07:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:739 2024-09-27 17:07:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:740 2024-09-27 17:08:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:741 2024-09-27 17:08:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:742 2024-09-27 17:08:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:743 2024-09-27 17:08:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:744 2024-09-27 17:08:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:745 2024-09-27 17:08:06 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BEHR-PREMIUM-1-qt-MQ2-33-Parisian-Café-Semi-Gloss-Enamel-Interior-Exterior-Cabinet-Door-Trim-Paint-712004/328091599', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:08:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:746 2024-09-27 17:08:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:747 2024-09-27 17:08:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:748 2024-09-27 17:08:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:749 2024-09-27 17:08:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:750 2024-09-27 17:08:13 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 0 pages/min), scraped 1877446 items (at 105557 items/min) 2024-09-27 17:08:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:751 2024-09-27 17:08:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:752 2024-09-27 17:08:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:753 2024-09-27 17:08:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:754 2024-09-27 17:08:25 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:755 2024-09-27 17:08:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:756 2024-09-27 17:08:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:757 2024-09-27 17:08:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:758 2024-09-27 17:08:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:759 2024-09-27 17:08:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:760 2024-09-27 17:08:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:761 2024-09-27 17:08:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:762 2024-09-27 17:08:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:763 2024-09-27 17:08:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:764 2024-09-27 17:08:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:765 2024-09-27 17:08:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:766 2024-09-27 17:08:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:767 2024-09-27 17:08:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:768 2024-09-27 17:08:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:769 2024-09-27 17:08:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:770 2024-09-27 17:08:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:771 2024-09-27 17:08:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:772 2024-09-27 17:08:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:773 2024-09-27 17:08:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:774 2024-09-27 17:08:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:775 2024-09-27 17:08:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:776 2024-09-27 17:08:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:777 2024-09-27 17:08:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:778 2024-09-27 17:08:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:779 2024-09-27 17:09:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:780 2024-09-27 17:09:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:781 2024-09-27 17:09:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:782 2024-09-27 17:09:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:783 2024-09-27 17:09:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:784 2024-09-27 17:09:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:785 2024-09-27 17:09:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:786 2024-09-27 17:09:10 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:787 2024-09-27 17:09:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:788 2024-09-27 17:09:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:789 2024-09-27 17:09:13 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 0 pages/min), scraped 1974158 items (at 96712 items/min) 2024-09-27 17:09:14 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:790 2024-09-27 17:09:16 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:791 2024-09-27 17:09:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:792 2024-09-27 17:09:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:793 2024-09-27 17:09:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:794 2024-09-27 17:09:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:795 2024-09-27 17:09:23 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:796 2024-09-27 17:09:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:797 2024-09-27 17:09:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:798 2024-09-27 17:09:27 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:799 2024-09-27 17:09:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:800 2024-09-27 17:09:30 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:801 2024-09-27 17:09:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:802 2024-09-27 17:09:33 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:803 2024-09-27 17:09:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:804 2024-09-27 17:09:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:805 2024-09-27 17:09:37 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:806 2024-09-27 17:09:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:807 2024-09-27 17:09:40 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:808 2024-09-27 17:09:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:809 2024-09-27 17:09:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:810 2024-09-27 17:09:44 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:811 2024-09-27 17:09:45 [scrapy.core.scraper] WARNING: Dropped: Validation failed! {'url': 'https://www.homedepot.com/p/BEHR-PREMIUM-1-qt-MQ2-33-Parisian-Café-Satin-Enamel-Interior-Exterior-Cabinet-Door-Trim-Paint-752004/328101022', 'sku': None, 'name': None, 'supplier': 'HOME_DEPOT'} 2024-09-27 17:09:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:812 2024-09-27 17:09:47 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:813 2024-09-27 17:09:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:814 2024-09-27 17:09:50 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:815 2024-09-27 17:09:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:816 2024-09-27 17:09:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:817 2024-09-27 17:09:54 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:818 2024-09-27 17:09:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:819 2024-09-27 17:09:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:820 2024-09-27 17:09:58 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:821 2024-09-27 17:10:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:822 2024-09-27 17:10:01 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:823 2024-09-27 17:10:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:824 2024-09-27 17:10:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:825 2024-09-27 17:10:05 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:826 2024-09-27 17:10:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:827 2024-09-27 17:10:08 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:828 2024-09-27 17:10:09 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:829 2024-09-27 17:10:11 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:830 2024-09-27 17:10:12 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:831 2024-09-27 17:10:13 [scrapy.extensions.logstats] INFO: Crawled 258 pages (at 0 pages/min), scraped 2080227 items (at 106069 items/min) 2024-09-27 17:10:13 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:832 2024-09-27 17:10:15 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:833 2024-09-27 17:10:17 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:834 2024-09-27 17:10:18 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:835 2024-09-27 17:10:20 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:836 2024-09-27 17:10:21 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:837 2024-09-27 17:10:22 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:838 2024-09-27 17:10:24 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:839 2024-09-27 17:10:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:840 2024-09-27 17:10:26 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:841 2024-09-27 17:10:28 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:842 2024-09-27 17:10:29 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:843 2024-09-27 17:10:31 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:844 2024-09-27 17:10:32 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:845 2024-09-27 17:10:34 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:846 2024-09-27 17:10:35 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:847 2024-09-27 17:10:36 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:848 2024-09-27 17:10:38 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:849 2024-09-27 17:10:39 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:850 2024-09-27 17:10:41 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:851 2024-09-27 17:10:42 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:852 2024-09-27 17:10:43 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:853 2024-09-27 17:10:45 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:854 2024-09-27 17:10:46 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:855 2024-09-27 17:10:48 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:856 2024-09-27 17:10:49 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:857 2024-09-27 17:10:51 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:858 2024-09-27 17:10:52 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:859 2024-09-27 17:10:53 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:860 2024-09-27 17:10:55 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:861 2024-09-27 17:10:56 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:862 2024-09-27 17:10:57 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:863 2024-09-27 17:10:59 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:864 2024-09-27 17:11:00 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:865 2024-09-27 17:11:02 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:866 2024-09-27 17:11:03 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:867 2024-09-27 17:11:04 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:868 2024-09-27 17:11:06 [scrapy.extensions.feedexport] INFO: Stored bq feed (2500 items) in: bq://response-elt.scraper_data.catalog_urls/batch:869 2024-09-27 17:11:07 [scrapy.core.engine] INFO: Closing spider (finished) 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] ------------------------------ MONITORS ------------------------------ 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... FAIL 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Error Count Monitor/test_stat_monitor... SKIPPED (Unable to find 'log_count/ERROR' in job stats.) 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... SKIPPED (Unable to find 'downloader/exception_count' in job stats.) 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-09-27 17:11:07 [home_depot] ERROR: [Spidermon] ====================================================================== FAIL: Extracted Items Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'item_scraped_count' to be '>=' to '2181000.0'. Current value: '2174783' 2024-09-27 17:11:07 [home_depot] ERROR: [Spidermon] ====================================================================== FAIL: Item Validation Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'spidermon/validation/fields/errors' to be '<=' to '0.0'. Current value: '376' 2024-09-27 17:11:07 [home_depot] ERROR: [Spidermon] ====================================================================== FAIL: Warning Count Monitor/test_stat_monitor ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor assertion_method( AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1.0'. Current value: '381' 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] 11 monitors in 0.003s 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] FAILED (failures=3, skipped=2) 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] -------------------------- FINISHED ACTIONS -------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] 0 actions in 0.000s 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] --------------------------- PASSED ACTIONS --------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] 0 actions in 0.000s 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] OK 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] --------------------------- FAILED ACTIONS --------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] ---------------------------------------------------------------------- 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] 0 actions in 0.000s 2024-09-27 17:11:07 [home_depot] INFO: [Spidermon] OK 2024-09-27 17:11:07 [scrapy.extensions.feedexport] INFO: Stored bq feed (2283 items) in: bq://response-elt.scraper_data.catalog_urls/batch:870 2024-09-27 17:11:07 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 498797, 'downloader/request_count': 258, 'downloader/request_method_count/GET': 258, 'downloader/response_bytes': 190098307, 'downloader/response_count': 258, 'downloader/response_status_count/200': 258, 'elapsed_time_seconds': 2813.987043, 'feedexport/success_count/BigQueryFeedStorage': 870, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2024, 9, 27, 17, 11, 7, 690942, tzinfo=datetime.timezone.utc), 'httpcompression/response_bytes': 254359969, 'httpcompression/response_count': 171, 'item_dropped_count': 376, 'item_dropped_reasons_count/DropItem': 376, 'item_scraped_count': 2174783, 'log_count/ERROR': 3, 'log_count/INFO': 954, 'log_count/WARNING': 381, 'memusage/max': 1193697280, 'memusage/startup': 113500160, 'poet/injector/catalog_discovery.pages.home_depot.HomeDepotSitemapPageObject': 258, 'request_depth_max': 2, 'response_received_count': 258, 'scheduler/dequeued': 258, 'scheduler/dequeued/memory': 258, 'scheduler/enqueued': 258, 'scheduler/enqueued/memory': 258, 'spidermon/validation/fields': 8700636, 'spidermon/validation/fields/errors': 376, 'spidermon/validation/fields/errors/invalid_uri': 376, 'spidermon/validation/fields/errors/invalid_uri/url': 376, 'spidermon/validation/items': 2175159, 'spidermon/validation/items/dropped': 376, 'spidermon/validation/items/errors': 376, 'spidermon/validation/validators': 1, 'spidermon/validation/validators/item/jsonschema': True, 'spidermon_field_coverage/dict/name': 1.0, 'spidermon_field_coverage/dict/sku': 1.0, 'spidermon_field_coverage/dict/supplier': 1.0, 'spidermon_field_coverage/dict/url': 1.0, 'spidermon_item_scraped_count': 2174783, 'spidermon_item_scraped_count/dict': 2174783, 'spidermon_item_scraped_count/dict/name': 2174783, 'spidermon_item_scraped_count/dict/sku': 2174783, 'spidermon_item_scraped_count/dict/supplier': 2174783, 'spidermon_item_scraped_count/dict/url': 2174783, 'start_time': datetime.datetime(2024, 9, 27, 16, 24, 13, 703899, tzinfo=datetime.timezone.utc)} 2024-09-27 17:11:07 [scrapy.core.engine] INFO: Spider closed (finished)