2026-03-05 02:02:33 [INFO] [scrapy.utils.log] Scrapy 2.13.3 started (bot: price_scraper)
2026-03-05 02:02:33 [INFO] [scrapy.utils.log] Versions:
{'lxml': '6.0.0',
'libxml2': '2.14.4',
'cssselect': '1.3.0',
'parsel': '1.10.0',
'w3lib': '2.3.1',
'Twisted': '25.5.0',
'Python': '3.12.11 (main, Jul 1 2025, 18:37:24) [Clang 20.1.4 ]',
'pyOpenSSL': '25.1.0 (OpenSSL 3.5.1 1 Jul 2025)',
'cryptography': '45.0.5',
'Platform': 'Linux-5.15.0-161-generic-x86_64-with-glibc2.35'}
2026-03-05 02:02:33 [INFO] [scrapy.addons] Enabled addons:
[]
2026-03-05 02:02:33 [DEBUG] [asyncio] Using selector: EpollSelector
2026-03-05 02:02:33 [DEBUG] [scrapy.utils.log] Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-05 02:02:33 [DEBUG] [scrapy.utils.log] Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-05 02:02:33 [INFO] [scrapy.middleware] Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'price_scraper.utils.per_spider_logger.PerSpiderFileLogger']
2026-03-05 02:02:33 [INFO] [scrapy.crawler] Overridden settings:
{'BOT_NAME': 'price_scraper',
'CONCURRENT_REQUESTS_PER_DOMAIN': 1,
'DOWNLOAD_DELAY': 1,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/07242bbc183711f18dfebd92ec2c210c.log',
'LOG_FORMAT': '%(asctime)s [%(levelname)s] [%(name)s] %(message)s',
'LOG_STDOUT': True,
'NEWSPIDER_MODULE': 'price_scraper.spiders',
'SPIDER_MODULES': ['price_scraper.spiders']}
2026-03-05 02:02:35 [INFO] [scrapy.middleware] Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-05 02:02:35 [INFO] [scrapy.middleware] Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-03-05 02:02:35 [INFO] [scrapy.middleware] Enabled item pipelines:
['price_scraper.pipelines.SheetsWriterPipeline']
2026-03-05 02:02:35 [INFO] [scrapy.core.engine] Spider opened
2026-03-05 02:02:35 [INFO] [ps.online72] File logging: /root/price-scraper/online72/online72_2026-03-05_020235.log
2026-03-05 02:02:35 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/07242bbc183711f18dfebd92ec2c210c.log
2026-03-05 02:02:35 [INFO] [ps.online72] Job logging: /Users/rodionulanov/projects/price-scraper/logs/price_scraper/online72/07242bbc183711f18dfebd92ec2c210c.log
2026-03-05 02:02:35 [INFO] [scrapy-playwright] Starting download handler
2026-03-05 02:02:35 [INFO] [scrapy-playwright] Starting download handler
2026-03-05 02:02:44 [INFO] [ps.online72] Start crawl: 1 URL(s)
2026-03-05 02:02:44 [INFO] [ps.online72] Start crawl: 1 URL(s)
2026-03-05 02:02:44 [INFO] [scrapy-playwright] Launching browser chromium
2026-03-05 02:02:46 [INFO] [scrapy-playwright] Browser chromium launched
2026-03-05 02:02:46 [DEBUG] [scrapy-playwright] Browser context started: 'default' (persistent=False, remote=False)
2026-03-05 02:02:48 [DEBUG] [scrapy-playwright] [Context=default] New page created, page count is 1 (1 for all contexts)
2026-03-05 02:02:49 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: document)
2026-03-05 02:02:50 [DEBUG] [scrapy-playwright] [Context=default] Response: <301 https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/> (location: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:02:50 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: document)
2026-03-05 02:02:50 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/>
2026-03-05 02:02:55 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:01 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:01 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:02 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:02 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/)
2026-03-05 02:03:04 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/)
2026-03-05 02:03:04 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:05 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:05 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:06 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:06 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:08 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:08 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:09 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:09 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:11 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:11 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:11 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:12 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:13 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:13 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:13 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:14 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:15 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:15 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:16 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:16 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:17 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:17 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:18 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:18 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:28 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/app.css?v3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product-grid.css?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product.css?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/header.js?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/animations.min.js?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/vendor.min.js?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/app.js?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://fonts.googleapis.com/css2?family=Inter:ital,wght@0,400..600;1,400..600&display=swap>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://fonts.googleapis.com/css2?family=Inter:wght@400..600&display=swap>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/brand/css/frontend_nav.css>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/brand/css/grouped_brands.css>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/waTheme.js?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/aspire.js?v3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/order.css?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.css?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.css?v=3.0.3.16)
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/custom.css?v=3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/js/lazy.load.js?v12.0.2.1200>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-content/js/jquery-plugins/jquery.cookie.js?v4.0.2>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/aspire.shop.js?v3.0.3.16>
2026-03-05 02:03:36 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/js/quantity.js?v=3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/js/custom.js?v=3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/aspiresense/css/panel.css?v=2.0.4>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/css/suggestions.20.min.css?v=2.0.4>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/js/jquery.suggestions.20.min.js?v2.0.4>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/css/frontend.min.css?v=2.0.4>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/cityselect/js/frontend.min.js?v=2.0.4>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/dgisreviews/css/dgisreviews.css?v=1771656146>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/dp-plugin/config/?v1.23.0>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/announcement-bar.css?v=3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/subheader.css?v=3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/images/logo.webp?v1767791382.3.0.3.16?v3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/images/logo_light.webp?v1732245583.3.0.3.16>
2026-03-05 02:03:37 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:38 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/products/56/36/13656/images/536/536.20x0.webp>
2026-03-05 02:03:38 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/scroll-shadow.js?v=3.0.3.16>
2026-03-05 02:03:38 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/instant-page.js?v=3.0.3.16>
2026-03-05 02:03:53 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/css/additional.aspire.shop.css>
2026-03-05 02:03:54 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:55 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:55 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:56 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:56 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:57 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:57 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:57 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:58 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:58 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:59 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:59 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:59 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:03:59 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:00 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:00 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:01 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:01 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:01 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:02 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:02 [WARNING] [scrapy-playwright] Closing page due to failed request: exc_type= exc_msg=Page.goto: Timeout 60000ms exceeded.
Call log:
- navigating to "https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/", waiting until "domcontentloaded"
Traceback (most recent call last):
File "/root/price-scraper/.venv/lib/python3.12/site-packages/scrapy_playwright/handler.py", line 433, in _download_request_with_retry
return await self._download_request_with_page(request, page, spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/price-scraper/.venv/lib/python3.12/site-packages/scrapy_playwright/handler.py", line 462, in _download_request_with_page
response, download = await self._get_response_and_download(request, page, spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/price-scraper/.venv/lib/python3.12/site-packages/scrapy_playwright/handler.py", line 564, in _get_response_and_download
response = await page.goto(url=request.url, **page_goto_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/price-scraper/.venv/lib/python3.12/site-packages/playwright/async_api/_generated.py", line 8992, in goto
await self._impl_obj.goto(
File "/root/price-scraper/.venv/lib/python3.12/site-packages/playwright/_impl/_page.py", line 556, in goto
return await self._main_frame.goto(**locals_to_params(locals()))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/price-scraper/.venv/lib/python3.12/site-packages/playwright/_impl/_frame.py", line 153, in goto
await self._channel.send(
File "/root/price-scraper/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 69, in send
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/price-scraper/.venv/lib/python3.12/site-packages/playwright/_impl/_connection.py", line 558, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.TimeoutError: Page.goto: Timeout 60000ms exceeded.
Call log:
- navigating to "https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/", waiting until "domcontentloaded"
2026-03-05 02:04:02 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/)
2026-03-05 02:04:02 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: script, referrer: https://online72.ru/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/)
2026-03-05 02:04:03 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet, referrer: https://online72.ru/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/)
2026-03-05 02:04:04 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: font, referrer: https://fonts.googleapis.com/)
2026-03-05 02:04:04 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr, referrer: https://online72.ru/)
2026-03-05 02:04:04 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/header-mobile-navigation.css?v=3.0.3.16>
2026-03-05 02:04:04 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/themes/aspiresense/js/page.product.js?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/dp/assets/core.js?_=1772676186162>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/breadcrumbs.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product-price.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: xhr)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [ERROR] [ps.online72] Request failed: Page.goto: Timeout 60000ms exceeded.
Call log:
- navigating to "https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/", waiting until "domcontentloaded"
| https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/
2026-03-05 02:04:07 [ERROR] [ps.online72] Request failed: Page.goto: Timeout 60000ms exceeded.
Call log:
- navigating to "https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/", waiting until "domcontentloaded"
| https://online72.ru/catalog/iphone/iphone-16-plus/iphone-16-plus-256gb-ultramarine/
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/tabbed-content.css?v=3.0.3>
2026-03-05 02:04:07 [INFO] [scrapy.core.engine] Closing spider (finished)
2026-03-05 02:04:07 [INFO] [ps.online72] Spider closed: reason=finished
2026-03-05 02:04:07 [INFO] [ps.online72] Spider closed: reason=finished
2026-03-05 02:04:07 [INFO] [ps.online72] Spider closed (signal): reason=finished
2026-03-05 02:04:07 [INFO] [ps.online72] Spider closed (signal): reason=finished
2026-03-05 02:04:07 [INFO] [scrapy.statscollectors] Dumping Scrapy stats:
{'downloader/exception_count': 1,
'downloader/exception_type_count/playwright._impl._errors.TimeoutError': 1,
'downloader/request_bytes': 275,
'downloader/request_count': 1,
'downloader/request_method_count/GET': 1,
'elapsed_time_seconds': 91.523664,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 3, 5, 2, 4, 7, 257002, tzinfo=datetime.timezone.utc),
'log_count/DEBUG': 134,
'log_count/ERROR': 1,
'log_count/INFO': 16,
'log_count/WARNING': 1,
'playwright/browser_count': 1,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/closed': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 89,
'playwright/request_count/method/GET': 89,
'playwright/request_count/navigation': 2,
'playwright/request_count/resource_type/document': 2,
'playwright/request_count/resource_type/font': 4,
'playwright/request_count/resource_type/image': 8,
'playwright/request_count/resource_type/script': 34,
'playwright/request_count/resource_type/stylesheet': 38,
'playwright/request_count/resource_type/xhr': 3,
'playwright/response_count': 59,
'playwright/response_count/method/GET': 59,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/image': 4,
'playwright/response_count/resource_type/script': 23,
'playwright/response_count/resource_type/stylesheet': 29,
'playwright/response_count/resource_type/xhr': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'start_time': datetime.datetime(2026, 3, 5, 2, 2, 35, 733338, tzinfo=datetime.timezone.utc)}
2026-03-05 02:04:07 [INFO] [scrapy.core.engine] Spider closed (finished)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/customer-reviews.css?v=3.0.3>
2026-03-05 02:04:07 [INFO] [scrapy-playwright] Closing download handler
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/collapsible-content.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product-grid.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/photoswipe.css?v=3.0.3>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: stylesheet)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/predictive-search.css?v=3.0.3.16>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/overlay-group.css?v=3.0.3.16>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/crm/css/form.css?3.3.2.724>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/crm/js/crm.frontend.form.js?3.3.2.724>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-content/js/jquery/jquery-1.11.1.min.js?v=4.0.2>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/slideshow.js?v=3.0.3.16>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Request: (resource type: image)
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/product.js?v=3.0.3.16>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/site/themes/aspiresense/assets/back-to-top.js?v=3.0.3.16>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-data/public/shop/products/56/36/13656/images/536/536.970x0.webp>
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] [Context=default] Response: <200 https://online72.ru/wa-apps/shop/plugins/aspiresense/js/section-templates.js?v=2.0.4>
2026-03-05 02:04:07 [INFO] [scrapy-playwright] Closing download handler
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] Browser context closed: 'default' (persistent=False, remote=False)
2026-03-05 02:04:07 [INFO] [scrapy-playwright] Closing browser
2026-03-05 02:04:07 [DEBUG] [scrapy-playwright] Browser disconnected