2026-07-29 17:09:19 [scrapy.utils.log] INFO: Scrapy 2.8.0 started (bot: modularspiders) 2026-07-29 17:09:19 [scrapy.utils.log] INFO: Versions: lxml 4.9.2.0, libxml2 2.9.14, cssselect 1.2.0, parsel 1.7.0, w3lib 2.1.1, Twisted 22.10.0, Python 3.10.15 (main, Oct 19 2024, 04:00:28) [GCC 12.2.0], pyOpenSSL 23.1.1 (OpenSSL 3.1.0 14 Mar 2023), cryptography 40.0.1, Platform Linux-5.10.0-21-amd64-x86_64-with-glibc2.36 2026-07-29 17:09:19 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'modularspiders', 'CLOSESPIDER_TIMEOUT': 3600, 'LOG_FILE': 'logs/default/vintageking/f9528adc8b6e11f197600242ac11000b.log', 'NEWSPIDER_MODULE': 'modularspiders.spiders', 'ROBOTSTXT_OBEY': True, 'SPIDER_MODULES': ['modularspiders.spiders'], 'USER_AGENT': 'Mozilla/5.0 (compatible; Googlebot/2.1; ' '+http://www.google.com/bot.html)'} 2026-07-29 17:09:19 [py.warnings] WARNING: /code/lib/python3.10/site-packages/scrapy/utils/request.py:232: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy. See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation. return cls(crawler) 2026-07-29 17:09:19 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2026-07-29 17:09:19 [scrapy.extensions.telnet] INFO: Telnet Password: e3863a167f7a264f 2026-07-29 17:09:20 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.telnet.TelnetConsole', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapy.extensions.closespider.CloseSpider'] 2026-07-29 17:09:20 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats'] 2026-07-29 17:09:20 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.offsite.OffsiteMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2026-07-29 17:09:20 [scrapy.middleware] INFO: Enabled item pipelines: ['modularspiders.pipelines.MinimumViableItemPipeline', 'modularspiders.pipelines.RedisExporter', 'modularspiders.pipelines.BulkStoreUpdate'] 2026-07-29 17:09:20 [scrapy.core.engine] INFO: Spider opened 2026-07-29 17:09:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-07-29 17:09:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026 2026-07-29 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:23 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:26 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:27 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:11:08 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 10 pages/min), scraped 0 items (at 0 items/min) 2026-07-29 17:12:23 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2026-07-29 17:12:23 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://vintageking.com/instruments/eurorack-and-modular-synths?p=10 took longer than 180.0 seconds.. 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:24 [scrapy.downloadermiddlewares.retry] DEBUG: Retrying (failed 1 times): User timeout caused connection failure: Getting https://vintageking.com/instruments/eurorack-and-modular-synths?p=11 took longer than 180.0 seconds.. 2026-07-29 17:12:24 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2026-07-29 17:12:27 [scrapy.dupefilters] DEBUG: Filtered duplicate request: - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates) 2026-07-29 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=1) 2026-07-29 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=12) 2026-07-29 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=12) 2026-07-29 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=12) 2026-07-29 17:12:28 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=12) 2026-07-29 17:12:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=8) 2026-07-29 17:12:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=7) 2026-07-29 17:12:29 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://vintageking.com/instruments/eurorack-and-modular-synths?p=12) 2026-07-29 17:27:28 [vintageking] WARNING: Redirecting from https://vintageking.com/instruments/eurorack-and-modular-synths/2hp-out-stereo-line-out-and-headphone-amplifier-module-black to canonical 2026-07-29 17:28:12 [vintageking] WARNING: Canonical found: https://vintageking.com/2hp-out-stereo-line-out-and-headphone-amplifier-module-black 2026-07-29 17:38:47 [vintageking] WARNING: Redirecting from https://vintageking.com/instruments/eurorack-and-modular-synths/xaoc-devices-konin-amplitenuverter to canonical 2026-07-29 17:38:47 [vintageking] WARNING: Canonical found: https://vintageking.com/xaoc-devices-konin-amplitenuverter 2026-07-29 17:47:32 [vintageking] WARNING: Redirecting from https://vintageking.com/instruments/eurorack-and-modular-synths/cre8audio-assembler-desktop-audio-mixer to canonical 2026-07-29 17:47:33 [vintageking] WARNING: Canonical found: https://vintageking.com/cre8audio-assembler-desktop-audio-mixer 2026-07-29 18:23:32 [vintageking] WARNING: Redirecting from https://vintageking.com/instruments/eurorack-and-modular-synths/2hp-out-stereo-line-out-and-headphone-amplifier-module-silver to canonical 2026-07-29 18:23:46 [vintageking] WARNING: Canonical found: https://vintageking.com/2hp-out-stereo-line-out-and-headphone-amplifier-module-silver