2024-09-05 18:16:00 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: checkout)
2024-09-05 18:16:00 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.9 (main, Aug 13 2024, 01:19:58) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-6.4.10-dirty-x86_64-with-glibc2.36
2024-09-05 18:16:00 [scrapy.addons] INFO: Enabled addons:
[]
2024-09-05 18:16:00 [asyncio] DEBUG: Using selector: EpollSelector
2024-09-05 18:16:00 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2024-09-05 18:16:00 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2024-09-05 18:16:00 [scrapy.extensions.telnet] INFO: Telnet Password: 7217980cca8a9262
2024-09-05 18:16:00 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.logstats.LogStats']
2024-09-05 18:16:00 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'checkout',
 'DUPEFILTER_CLASS': 'scrapy.dupefilters.BaseDupeFilter',
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/checkout/wbmason_login_monitoring/cf31baf86bb211ef93944200a9fe0102.log',
 'NEWSPIDER_MODULE': 'checkout.spiders',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['checkout.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) '
               'AppleWebKit/537.36 (KHTML, like Gecko) Chrome/126.0.0.0 '
               'Safari/537.36'}
2024-09-05 18:16:01 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2024-09-05 18:16:01 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2024-09-05 18:16:01 [scrapy.middleware] INFO: Enabled item pipelines:
[]
2024-09-05 18:16:01 [scrapy.core.engine] INFO: Spider opened
2024-09-05 18:16:01 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2024-09-05 18:16:01 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2024-09-05 18:16:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://login.wbmason.com/> from <GET https://login.wbmason.com/Account/Login>
2024-09-05 18:16:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://login.wbmason.com/connect/authorize?client_id=ecomClient&response_type=code&scope=openid%20api1%20profile%20offline_access&redirect_uri=https%3A%2F%2Fwww.wbmason.com%2FAccountLoading.aspx%3Fr%3Dhttps%3A%2F%2Fwww.wbmason.com&state=c775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%7Chttps%3A%2F%2Fwww.wbmason.com%2FAccountLoading.aspx%3Fr%3Dhttps%3A%2F%2Fwww.wbmason.com%7Cstd&nonce=PtbGFl%2FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%2F7C5Ck2W1xYQ%3D%3D&prompt=login&response_mode=form_post&code_challenge=51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q&code_challenge_method=S256&Dgl=True&Drl=True&se=False&ku=False&r=True> from <GET https://login.wbmason.com/>
2024-09-05 18:16:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://login.wbmason.com/Account/Login?ReturnUrl=%2Fconnect%2Fauthorize%2Fcallback%3Fclient_id%3DecomClient%26response_type%3Dcode%26scope%3Dopenid%2520api1%2520profile%2520offline_access%26redirect_uri%3Dhttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%26state%3Dc775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%257Chttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%257Cstd%26nonce%3DPtbGFl%252FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%252F7C5Ck2W1xYQ%253D%253D%26prompt%3Dlogin%26response_mode%3Dform_post%26code_challenge%3D51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q%26code_challenge_method%3DS256%26Dgl%3DTrue%26Drl%3DTrue%26se%3DFalse%26ku%3DFalse%26r%3DTrue%26suppressed_prompt%3Dlogin> from <GET https://login.wbmason.com/connect/authorize?client_id=ecomClient&response_type=code&scope=openid%20api1%20profile%20offline_access&redirect_uri=https%3A%2F%2Fwww.wbmason.com%2FAccountLoading.aspx%3Fr%3Dhttps%3A%2F%2Fwww.wbmason.com&state=c775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%7Chttps%3A%2F%2Fwww.wbmason.com%2FAccountLoading.aspx%3Fr%3Dhttps%3A%2F%2Fwww.wbmason.com%7Cstd&nonce=PtbGFl%2FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%2F7C5Ck2W1xYQ%3D%3D&prompt=login&response_mode=form_post&code_challenge=51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q&code_challenge_method=S256&Dgl=True&Drl=True&se=False&ku=False&r=True>
2024-09-05 18:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://login.wbmason.com/Account/Login?ReturnUrl=%2Fconnect%2Fauthorize%2Fcallback%3Fclient_id%3DecomClient%26response_type%3Dcode%26scope%3Dopenid%2520api1%2520profile%2520offline_access%26redirect_uri%3Dhttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%26state%3Dc775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%257Chttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%257Cstd%26nonce%3DPtbGFl%252FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%252F7C5Ck2W1xYQ%253D%253D%26prompt%3Dlogin%26response_mode%3Dform_post%26code_challenge%3D51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q%26code_challenge_method%3DS256%26Dgl%3DTrue%26Drl%3DTrue%26se%3DFalse%26ku%3DFalse%26r%3DTrue%26suppressed_prompt%3Dlogin> (referer: None)
2024-09-05 18:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://login.wbmason.com/Account/Login?ReturnUrl=%2Fconnect%2Fauthorize%2Fcallback%3Fclient_id%3DecomClient%26response_type%3Dcode%26scope%3Dopenid%2520api1%2520profile%2520offline_access%26redirect_uri%3Dhttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%26state%3Dc775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%257Chttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%257Cstd%26nonce%3DPtbGFl%252FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%252F7C5Ck2W1xYQ%253D%253D%26prompt%3Dlogin%26response_mode%3Dform_post%26code_challenge%3D51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q%26code_challenge_method%3DS256%26Dgl%3DTrue%26Drl%3DTrue%26se%3DFalse%26ku%3DFalse%26r%3DTrue%26suppressed_prompt%3Dlogin> (referer: None)
2024-09-05 18:16:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://login.wbmason.com/Account/Login?ReturnUrl=%2Fconnect%2Fauthorize%2Fcallback%3Fclient_id%3DecomClient%26response_type%3Dcode%26scope%3Dopenid%2520api1%2520profile%2520offline_access%26redirect_uri%3Dhttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%26state%3Dc775e7b757ede630cd0aa1113bd102661ab38829ca52a6422ab782862f268646%257Chttps%253A%252F%252Fwww.wbmason.com%252FAccountLoading.aspx%253Fr%253Dhttps%253A%252F%252Fwww.wbmason.com%257Cstd%26nonce%3DPtbGFl%252FQVNSzb39Yz3SR4wWWSzGEx3xrFy0UWBWV60Of5MYLWHRZeXtJqXrNeI0y8uBFoMlKzB%252F7C5Ck2W1xYQ%253D%253D%26prompt%3Dlogin%26response_mode%3Dform_post%26code_challenge%3D51FaJvQFsiNdiFWIq2EMWUKeAqD47dqU_cHzJpfHl-Q%26code_challenge_method%3DS256%26Dgl%3DTrue%26Drl%3DTrue%26se%3DFalse%26ku%3DFalse%26r%3DTrue%26suppressed_prompt%3Dlogin>
{'vendor': 'WB_MASON', 'incorrectLogin': True}
2024-09-05 18:16:02 [scrapy.core.engine] INFO: Closing spider (finished)
2024-09-05 18:16:02 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 4557,
 'downloader/request_count': 5,
 'downloader/request_method_count/GET': 4,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 27895,
 'downloader/response_count': 5,
 'downloader/response_status_count/200': 2,
 'downloader/response_status_count/302': 3,
 'elapsed_time_seconds': 1.18497,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2024, 9, 5, 18, 16, 2, 247845, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1,
 'log_count/DEBUG': 9,
 'log_count/INFO': 10,
 'memusage/max': 80977920,
 'memusage/startup': 80977920,
 'request_depth_max': 1,
 'response_received_count': 2,
 'scheduler/dequeued': 5,
 'scheduler/dequeued/memory': 5,
 'scheduler/enqueued': 5,
 'scheduler/enqueued/memory': 5,
 'start_time': datetime.datetime(2024, 9, 5, 18, 16, 1, 62875, tzinfo=datetime.timezone.utc)}
2024-09-05 18:16:02 [scrapy.core.engine] INFO: Spider closed (finished)