2026-02-17 12:36:51 [INFO] [scrapy.utils.log] Scrapy 2.13.3 started (bot: price_scraper) 2026-02-17 12:36:51 [INFO] [scrapy.utils.log] Versions: {'lxml': '6.0.0', 'libxml2': '2.14.4', 'cssselect': '1.3.0', 'parsel': '1.10.0', 'w3lib': '2.3.1', 'Twisted': '25.5.0', 'Python': '3.12.11 (main, Jul 1 2025, 18:37:24) [Clang 20.1.4 ]', 'pyOpenSSL': '25.1.0 (OpenSSL 3.5.1 1 Jul 2025)', 'cryptography': '45.0.5', 'Platform': 'Linux-5.15.0-161-generic-x86_64-with-glibc2.35'} 2026-02-17 12:36:51 [INFO] [scrapy.addons] Enabled addons: [] 2026-02-17 12:36:51 [DEBUG] [asyncio] Using selector: EpollSelector 2026-02-17 12:36:51 [DEBUG] [scrapy.utils.log] Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-02-17 12:36:51 [DEBUG] [scrapy.utils.log] Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-02-17 12:36:51 [INFO] [scrapy.middleware] Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'price_scraper.utils.per_spider_logger.PerSpiderFileLogger'] 2026-02-17 12:36:51 [INFO] [scrapy.crawler] Overridden settings: {'BOT_NAME': 'price_scraper', 'CONCURRENT_REQUESTS_PER_DOMAIN': 1, 'DOWNLOAD_DELAY': 1, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b9ea91740bf211f18dfebd92ec2c210c.log', 'LOG_FORMAT': '%(asctime)s [%(levelname)s] [%(name)s] %(message)s', 'LOG_STDOUT': True, 'NEWSPIDER_MODULE': 'price_scraper.spiders', 'SPIDER_MODULES': ['price_scraper.spiders']} 2026-02-17 12:36:54 [INFO] [scrapy.middleware] Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-02-17 12:36:54 [INFO] [scrapy.middleware] Enabled spider middlewares: ['scrapy.spidermiddlewares.start.StartSpiderMiddleware', 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-02-17 12:36:54 [INFO] [scrapy.middleware] Enabled item pipelines: ['price_scraper.pipelines.SheetsWriterPipeline'] 2026-02-17 12:36:54 [INFO] [scrapy.core.engine] Spider opened 2026-02-17 12:36:54 [INFO] [ps.online72] File logging: /root/price-scraper/online72/online72_2026-02-17_123654.log 2026-02-17 12:36:54 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b9ea91740bf211f18dfebd92ec2c210c.log 2026-02-17 12:36:54 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b9ea91740bf211f18dfebd92ec2c210c.log 2026-02-17 12:36:54 [INFO] [scrapy-playwright] Starting download handler 2026-02-17 12:36:54 [INFO] [scrapy-playwright] Starting download handler 2026-02-17 12:36:54 [INFO] [scrapy.crawler] Received SIGINT, shutting down gracefully. Send again to force 2026-02-17 12:36:57 [CRITICAL] [twisted] Unhandled error in Deferred: 2026-02-17 12:36:57 [CRITICAL] [twisted] Traceback (most recent call last): File "/root/price-scraper/.venv/lib/python3.12/site-packages/twisted/internet/defer.py", line 1853, in _inlineCallbacks result = context.run( ^^^^^^^^^^^^ File "/root/price-scraper/.venv/lib/python3.12/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator return g.throw(self.value.with_traceback(self.tb)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/root/price-scraper/.venv/lib/python3.12/site-packages/scrapy/crawler.py", line 178, in stop yield maybeDeferred(self.engine.stop) File "/root/price-scraper/.venv/lib/python3.12/site-packages/twisted/internet/defer.py", line 216, in maybeDeferred result = f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File "/root/price-scraper/.venv/lib/python3.12/site-packages/scrapy/core/engine.py", line 159, in stop raise RuntimeError("Engine not running") RuntimeError: Engine not running