2026-03-09 03:03:15 [INFO] [scrapy.utils.log] Scrapy 2.13.3 started (bot: price_scraper) 2026-03-09 03:03:15 [INFO] [scrapy.utils.log] Versions: {'lxml': '6.0.0', 'libxml2': '2.14.4', 'cssselect': '1.3.0', 'parsel': '1.10.0', 'w3lib': '2.3.1', 'Twisted': '25.5.0', 'Python': '3.12.11 (main, Jul 1 2025, 18:37:24) [Clang 20.1.4 ]', 'pyOpenSSL': '25.1.0 (OpenSSL 3.5.1 1 Jul 2025)', 'cryptography': '45.0.5', 'Platform': 'Linux-5.15.0-161-generic-x86_64-with-glibc2.35'} 2026-03-09 03:03:15 [INFO] [scrapy.addons] Enabled addons: [] 2026-03-09 03:03:15 [DEBUG] [asyncio] Using selector: EpollSelector 2026-03-09 03:03:15 [DEBUG] [scrapy.utils.log] Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor 2026-03-09 03:03:15 [DEBUG] [scrapy.utils.log] Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop 2026-03-09 03:03:15 [INFO] [scrapy.middleware] Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'price_scraper.utils.per_spider_logger.PerSpiderFileLogger'] 2026-03-09 03:03:15 [INFO] [scrapy.crawler] Overridden settings: {'BOT_NAME': 'price_scraper', 'CONCURRENT_REQUESTS_PER_DOMAIN': 1, 'DOWNLOAD_DELAY': 1, 'FEED_EXPORT_ENCODING': 'utf-8', 'LOG_FILE': '/Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b3d2013c1b5b11f18dfebd92ec2c210c.log', 'LOG_FORMAT': '%(asctime)s [%(levelname)s] [%(name)s] %(message)s', 'LOG_STDOUT': True, 'NEWSPIDER_MODULE': 'price_scraper.spiders', 'SPIDER_MODULES': ['price_scraper.spiders']} 2026-03-09 03:03:17 [INFO] [scrapy.middleware] Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-03-09 03:03:17 [INFO] [scrapy.middleware] Enabled spider middlewares: ['scrapy.spidermiddlewares.start.StartSpiderMiddleware', 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-03-09 03:03:17 [INFO] [scrapy.middleware] Enabled item pipelines: ['price_scraper.pipelines.SheetsWriterPipeline'] 2026-03-09 03:03:17 [INFO] [scrapy.core.engine] Spider opened 2026-03-09 03:03:17 [INFO] [ps.online72] File logging: /root/price-scraper/online72/online72_2026-03-09_030317.log 2026-03-09 03:03:17 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b3d2013c1b5b11f18dfebd92ec2c210c.log 2026-03-09 03:03:17 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/b3d2013c1b5b11f18dfebd92ec2c210c.log 2026-03-09 03:03:17 [INFO] [scrapy-playwright] Starting download handler 2026-03-09 03:03:17 [INFO] [scrapy-playwright] Starting download handler 2026-03-09 03:03:27 [INFO] [ps.online72] Start crawl: 1 URL(s) 2026-03-09 03:03:27 [INFO] [ps.online72] Start crawl: 1 URL(s) 2026-03-09 03:03:27 [INFO] [scrapy-playwright] Launching browser chromium 2026-03-09 03:03:27 [INFO] [scrapy-playwright] Browser chromium launched 2026-03-09 03:03:27 [DEBUG] [scrapy-playwright] Browser context started: 'default' (persistent=False, remote=False) 2026-03-09 03:03:28 [DEBUG] [scrapy-playwright] [Context=default] New page created, page count is 1 (1 for all contexts) 2026-03-09 03:03:28 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: document) 2026-03-09 03:03:29 [DEBUG] [scrapy-playwright] [Context=default] Response: <301 https://online72.ru/catalog/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/> (location: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:29 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: document) 2026-03-09 03:03:29 [DEBUG] [scrapy-playwright] [Context=default] Response: <404 https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/> 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:31 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:32 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/app.css?v3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product-grid.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/animations.min.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/header.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/vendor.min.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/app.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/brand/css/frontend_nav.css> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/brand/css/grouped_brands.css> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/waTheme.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/aspire.js?v3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/order.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/custom.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/js/lazy.load.js?v12.1.0.1207> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-content/js/jquery-plugins/jquery.cookie.js?v4.0.3> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.js?v3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://fonts.googleapis.com/css2?family=Inter:ital,wght@0,400..600;1,400..600&display=swap> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://fonts.googleapis.com/css2?family=Inter:wght@400..600&display=swap> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/js/quantity.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/js/custom.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.css?v=3.0.3.16) 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/aspiresense/css/panel.css?v=2.0.4> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/css/suggestions.20.min.css?v=2.0.4> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/js/jquery.suggestions.20.min.js?v2.0.4> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/css/frontend.min.css?v=2.0.4> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/js/frontend.min.js?v=2.0.4> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/dgisreviews/css/dgisreviews.css?v=1772972935> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/announcement-bar.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/subheader.css?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/images/logo.webp?v1767791382.3.0.3.16?v3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/images/logo_light.webp?v1732245583.3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/scroll-shadow.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/instant-page.js?v=3.0.3.16> 2026-03-09 03:03:33 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/dp-plugin/config/?v1.23.0> 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/additional.aspire.shop.css> 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:34 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr, referrer: https://online72.ru/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/header-mobile-navigation.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/404.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/) 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/dp/assets/core.js?_=1773025412026> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/predictive-search.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/overlay-group.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/crm/css/form.css?3.3.2.724> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/crm/js/crm.frontend.form.js?3.3.2.724> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-content/js/jquery/jquery-1.11.1.min.js?v=4.0.3> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/slideshow.js?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product.js?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/back-to-top.js?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/aspiresense/js/section-templates.js?v=2.0.4> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/footer.js?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/aspiresense/js/panel.js?v=2.0.4> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/footer.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/mobile-menu.css?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/predictive-search.js?v=3.0.3.16> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/modal-dialog.js?v=3.0.3.16> 2026-03-09 03:03:35 [WARNING] [scrapy-playwright] Ignoring ('wait_for_selector', "script[type='application/ld+json']", {'timeout': 15000}): expected PageMethod, got 2026-03-09 03:03:35 [WARNING] [scrapy-playwright] Ignoring ('wait_for_selector', '.price_group .price_value', {'timeout': 15000}): expected PageMethod, got 2026-03-09 03:03:35 [WARNING] [scrapy-playwright] Ignoring ('wait_for_selector', "[itemprop='price']", {'timeout': 15000}): expected PageMethod, got 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://suggestions.dadata.ru/suggestions/api/4_1/rs/detectAddressByIp?_=1773025412027> 2026-03-09 03:03:35 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr, referrer: https://online72.ru/) 2026-03-09 03:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://mc.yandex.ru/metrika/tag.js> 2026-03-09 03:03:37 [DEBUG] [scrapy.core.engine] Crawled (404) (referer: None) ['playwright'] 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://fonts.gstatic.com/s/inter/v20/UcCO3FwrK3iLTeHuS_nVMrMxCp50SjIw2boKoduKmMEVuLyfMZg.ttf> 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://suggestions.dadata.ru/suggestions/api/4_1/rs/findById/address> 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr) 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image) 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: fetch) 2026-03-09 03:03:37 [WARNING] [ps.online72] Non-200 response: HTTP 404 | https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [WARNING] [ps.online72] Non-200 response: HTTP 404 | https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [WARNING] [ps.online72] Price not found | https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [WARNING] [ps.online72] Price not found | https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [INFO] [ps.pipeline] Item: row=415 price= status=❌ Не найдена цена url=https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [INFO] [ps.pipeline] Item: row=415 price= status=❌ Не найдена цена url=https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/ 2026-03-09 03:03:37 [DEBUG] [scrapy.core.scraper] Scraped from <404 https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/> {'title': 'Страница не найдена', 'price': None, 'url': 'https://online72.ru/ipad/ipad-pro-11-m4-2024/ipad-pro-11-m4-1tb-wi-fi-2024-space-black/', 'status': '❌ Не найдена цена', 'row': '415', 'price_column': 'H', 'errors_column': 'I'} 2026-03-09 03:03:37 [INFO] [scrapy.core.engine] Closing spider (finished) 2026-03-09 03:03:37 [INFO] [ps.pipeline] Pipeline: 1 result(s) -> results.json 2026-03-09 03:03:37 [INFO] [ps.pipeline] Pipeline: 1 result(s) -> results.json 2026-03-09 03:03:37 [INFO] [ps.online72] Spider closed: reason=finished 2026-03-09 03:03:37 [INFO] [ps.online72] Spider closed: reason=finished 2026-03-09 03:03:37 [INFO] [ps.online72] Spider closed (signal): reason=finished 2026-03-09 03:03:37 [INFO] [ps.online72] Spider closed (signal): reason=finished 2026-03-09 03:03:37 [INFO] [scrapy.statscollectors] Dumping Scrapy stats: {'downloader/request_bytes': 287, 'downloader/request_count': 1, 'downloader/request_method_count/GET': 1, 'downloader/response_bytes': 292119, 'downloader/response_count': 1, 'downloader/response_status_count/404': 1, 'elapsed_time_seconds': 19.711484, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2026, 3, 9, 3, 3, 37, 449381, tzinfo=datetime.timezone.utc), 'item_scraped_count': 1, 'log_count/DEBUG': 132, 'log_count/INFO': 18, 'log_count/WARNING': 5, 'playwright/browser_count': 1, 'playwright/context_count': 1, 'playwright/context_count/max_concurrent': 1, 'playwright/context_count/persistent/False': 1, 'playwright/context_count/remote/False': 1, 'playwright/page_count': 1, 'playwright/page_count/closed': 1, 'playwright/page_count/max_concurrent': 1, 'playwright/request_count': 66, 'playwright/request_count/method/GET': 64, 'playwright/request_count/method/POST': 2, 'playwright/request_count/navigation': 2, 'playwright/request_count/resource_type/document': 2, 'playwright/request_count/resource_type/fetch': 1, 'playwright/request_count/resource_type/font': 4, 'playwright/request_count/resource_type/image': 3, 'playwright/request_count/resource_type/script': 28, 'playwright/request_count/resource_type/stylesheet': 24, 'playwright/request_count/resource_type/xhr': 4, 'playwright/response_count': 59, 'playwright/response_count/method/GET': 58, 'playwright/response_count/method/POST': 1, 'playwright/response_count/resource_type/document': 2, 'playwright/response_count/resource_type/font': 1, 'playwright/response_count/resource_type/image': 2, 'playwright/response_count/resource_type/script': 27, 'playwright/response_count/resource_type/stylesheet': 24, 'playwright/response_count/resource_type/xhr': 3, 'response_received_count': 1, 'scheduler/dequeued': 1, 'scheduler/dequeued/memory': 1, 'scheduler/enqueued': 1, 'scheduler/enqueued/memory': 1, 'start_time': datetime.datetime(2026, 3, 9, 3, 3, 17, 737897, tzinfo=datetime.timezone.utc)} 2026-03-09 03:03:37 [INFO] [scrapy.core.engine] Spider closed (finished) 2026-03-09 03:03:37 [INFO] [scrapy-playwright] Closing download handler 2026-03-09 03:03:37 [INFO] [scrapy-playwright] Closing download handler 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] Browser context closed: 'default' (persistent=False, remote=False) 2026-03-09 03:03:37 [INFO] [scrapy-playwright] Closing browser 2026-03-09 03:03:37 [DEBUG] [scrapy-playwright] Browser disconnected